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ABSTRACT 


This dissertation investigates the problem of automatic 
transcription of the hand-keyed Morse Signal. A unified 
model for this signal process transmitted over a noisy 
channel is shown to be a system in which the state of the 
Morse process evolves aS a memory-conditioned probabilistic 
mapping of a conditional Markov process, with the state of 
this process playing the role of a parameter vector of the 
channel model. The decoding problem is then vosed as finding 
an optimal estimate of the state of the Morse process, given 
a sequence of measurements of the detected signal. The 
Bayesian solution to this nonlinear estimation problem is 
obtained explicitly for the parameter-conditional linear- 
gaussian channel, and the resulting optimal decoder is shown 
to consist of a denumerable but exponentially expanding set 
of linear Kalman filters operating on a dynamically evolving 
trellis. Decoder performance is obtained by computer simula- 
tion, for the case of random letter message texts. For 
nonrandom texts, further research is indicated to svecify 
linguistic and format-dependent models consistent with the 


model structure developed herein. 
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io NERObUCTAON 


The problem of automatically transcribing the hand-keyed 
manual morse (HKM) signal with an acceptable error rate, 
without exact knowledge of the sender's keying character- 
istics and transmitted signal parameters, has, in general, 
remained unsolved. The easier companion problem of auto- 
matically transcribing a Morse signal sent by a keyboard 
(KAM), and whose transmitted frequency is known, has largely 
been solved, and a number of Morse decoders are commercially 
available for this task. These decoders also can be used 
on the HKM signal, but with considerable loss in performance 
except in cases of very good keying quality. 

The difficulty of automatically transcribing the HKM 
Signal (problems in frequency acquisition and detection 
aside) is often not recognized by the uninitiated. fThis 
difficulty is analogous to that of designing an automatic 
Speech recognition device. While the analogy cannot be 
taken too far, certain parallels are evident. The HKM 
Signal, being a human-generated process, has all the char- 
Metmeristics Of individuality associated with such a process. 
No two senders of Morse send in exactly the same way, just 
as no two speakers speak in exactly the same way. Yet a 
trained Morse operator can understand what is being sent, 
just as a person who understands the language of a speaker 
can understand (almost) anyone who speaks that language, 


whatever the individual characteristics of his speech. A 
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Morse transcription machine for HKM which bases its deci- 
sions solely on the local Morse symbols (dot, dash, element 
Space, character space, word space, pause) can, with some 
imagination, be likened to a situation in which a person 
who does not know English attempts to translate a spoken 
English phrase by isolating the syllables of the words. 
Clearly the Morse transcription task is not quite so diffi- 
cult as this analogy since there are only six "syllables" 
in Morse; yet the analogy is illustrative of the difficulty 
of transcribing the HKM process. 

On the other hand, the KAM signal can be likened to a 
teletype signal with a well-defined structure. Thus it is 
sufficient to decode such a signal on the basis of the baud 
structure, since there is a one-to-one mapping from the code 
words to the text. This non-singular mapping accounts for 
the relative ease of decoding a demodulated KAM signal. 

The above analogy has tacitly assumed that the Morse 
waveform was perfectly demodulated. In the real world of 
imperfect demodulation, it is clear than an HKM transcription 
machine which uses only local information, can provide no 
eeror—-correction capability to correct incorrectly demodu- 
lated Morse symbols. Thus as a result of a single incorrect 
demodulation decision, an entire letter (two letters if the 
symbol was a character space) is transcribed incorrectly. 
Demodulation, therefore, must be considered as an integral 


part of the HKM processor, and this processor must have some 
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knowledge of the Morse "language" in order to provide error- 
correction capability. 

This paper reports the results of an investigation into 
the problem of automatically transcribing the HKM process. 

The problem is attacked from the point-of-view of optimal 
estimation and modern information theory. Theoretical results 
are derived which can be directly applied to the design of an 
optimal HKM transcriber. It is shown that such an optimal 
transcriber is unrealizable in the practical sense, but that 

a suboptimal transcriber which can be made arbitrarily close 

to optimal is realizable. Lower bounds on the theoretical 
error-rate performance of an ideal transcriber are obtained 

as a function of signal-to-noise ratio, keying characteristics, 
and HKM model complexity. The verformance of the suboptimal 
transcriber is obtained by computer simulation and compared 

to the theoretical results for the optimal transcriber. 
Finally, the suboptimal transcriber is tested against a limited 
set of field data in order to validate the simulations. 

The report is organized into two parts: theoretical and 
application. In the theoretical section, a unified model 
structure for the HKM process 1s derived which may account for 
code symbol dependencies, variation in data rate, operator 
sending anomalies, source letter context, message format, and 
linguistic dependencies. A channel model is constructed to 
Beeount for transmitter, propagation, and receiver effects. 
The resulting modeled system is shown to be a system in which 
the state of the HKM process evolves as a memory-conditioned 


probabilistic mapping of a conditional Markov process, with 
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the state of this process playing the role of a parameter 
vector of the channel and meaSurement models. The joint 
demodulation, decoding, and translation problem is then 
posed as finding an optimal estimate of the discrete state 
of the HKM signal process, given a sequence of noisy measure- 
ments of the detected signal. The Bayesian solution to this 
nonlinear estimation problem is obtained explicitly for the 
case of parameter-conditional linear-gaussian channel and 
measurement models, and the resulting optimal Morse 
transcription machine is shown to consist of a denumerable 
but exponentially expanding set of linear Kalman filters 
Operating on a trellis defined by the discrete state values 
of the parameter vector. Because of the exponential growth, 
the optimal estimator is unrealizable, and a realizable 
Suboptimal solution which adaptively restricts the growth 
of the trellis is obtained. 

The application section shows how a specific modei of the 
HKM process results from the general model constructed in the 
theoretical section. It is shown in principle how the 
generality of the model readily provides for any level of 
complexity in modeling an actual Morse message, l.e. froma 
very simple model of local Morse symbols up to and including 
a complex model of syntactic and semantic rules for the Morse 
"language." It is shown theoretically how context may be used 
to provide error-correction capabilitv and reduce the lower- 
bound on output letter-error rate. Simulation results are 
obtained which confirm the expected improved performance for 


increasingly complex modeling of the Morse message. 
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eo hOb bE DESCRIP? LON 


The statement of the problem is actually very simple: 
Obtain a processor which will transcribe hand-keyed manual 
Morse as well as a human operator. The simplicity of the 
statement, however, belies the complexity of describing a 
"hand-keyed manual Morse" signal and the difficulty of 


quantifying the phrase "as well as a human operator." 


A. THE HAND-KEYED MANUAL MORSE (HKM) SIGNAL PROCESS 
As used throughout this report, the term HKM signal 
refers to International Morse Code and its derivatives sent 
manually by key, mechanical bug, or electronic bug. The 
baseband HKM process is the output voltage level of the keyer 
and is represented by the logic levels 0 and 1, corresponding 
to the states "key up" and "key down." The six symbols of 
Me~emcoae are; dot, dash, element-space, character-space, 
Peeeespace, and pause. The term element (or baie reters 
to the standard time unit of the code; its actual duration 
in seconds will of course vary with sending speed. Standard 
Morse code consists of the symbol durations shown in Table I. 
The standard word (including word-space) in Morse commun- 
ication is 50 elements in length. Thus the standard element 
duration in seconds for a given sending speed is 6/5 times 
the reciprocal of the speed in words-per-minute. The 
instantaneous data rate for an HKM Signal is defined to be 


6/5 times the reciprocal of the duration of the symbol (in 
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TABLE I 


Standard Morse Symbols 


Name Symbol Duration (in elements) 
Bot : 1 
Dash = 3 
Element-space ms le 
Character-space % 3 
Word-space W 7 

Pp 


Pause 14 
seconds) divided by the standard duration in elements; 
e.g., the instantaneous data rate for a dash of duration 
60 msec is (6/5)/(1/.020) = 60 wpm. 

An HKM signal differs from the standard Morse signal 
in that the instantaneous data rate is a random variable, 
resulting in symbol durations which are random. The element 
duration is defined to be the mean value of the dot duration; 
this mean value is also a random variable. The HKM signal 
may exhibit a large variation in both element duration and 
instantaneous data rate. The modeling of these random variables 
is discussed in section VI.A. The distributions of element 
duration and instantaneous data rate are unique to a particu- 
lar sending operator, and in most cases depend on the type 
of traffic being sent, and on the intended recipient of the 


Slgnal as well. 


iu: 





B. THE HKM SIGNAL CHANNEL 

The HKM signal process is usually transmitted at HF by 
a transmitter whose final amplifier is on-off keyed (OOK) 
by the keyer, although in some cases, the oscillator itself 
is on-off keyed. Because of the effect of transients in the 
transmitter, the signal is usually chirped to some extent, 
the magnitude of the chirp being indicative of the quality 
of the transmitter design and state of maintenance. For 
well-designed, properly maintained transmitters, the chirp 
is on the order of tens of Hertz. Poorly designed or improp- 
erly maintained transmitters may exhibit as much as 300Hz 
chirp, as well as random drift of the nominal carrier fre- 
quency. Thus in most cases, Signal detection must be accom- 
plished by using an envelope detector since the phase of 
the signal is not known. 

In addition to the signal uncertainties caused by the 
transmitter itself, the signal is also corrupted by both 
additive and multiplicative noise in the form of atmospherics, 
interference, and fading, which at HF is nonstationary. Thus 
demodulation of the OOK Signal must be accomplished in the 
face of frequency, phase, and amplitude uncertainty, along 


with incomplete knowledge of the noise statistics. 


Ga OPERATOR PERFORMANCE 
The ultimate goal of the Morse transcriber is to provide 
output copy with an error rate approaching that which a 


typical human operator provides. The human operator rapidly 
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adapts to changing Signal and channel parameters and can 
provide reliable copy of a highly variable HKM signal in the 
presence of numerous other Morse and non-Morse signals. The 
Operator is obviously aided by an understanding of the context 
of the message, the format, and the Morse "language." 

The available data on operator performance is summarized 
in Figures 1 and 2. Figure 1 is a plot of error rate vs. 
SNR for an actual communications link in the LF band reported 
by Watt et. al. [1], while Figure 2 shows the performance 
obtained ina laboratory experiment [2]. Both tests were 
conducted uSing random five-letter code groups as the test 
message. Table II, from Lane [3], shows the number of dB 
which must be added or subtracted from the abscissa of the 
performance curve to obtain the performance for different 
speeds of transmission. Clearly the laboratory tests show 
a better performance capability for the human operator than 
that obtained for the actual communication link, with a 
difference of about 2-3 dB for equal error rates. Such an 
observation indicates that one must design the automated 
transcriber using the laboratory performance measurements 
in order to obtain the required performance under field 
Seneaitions for the same SNR. 

The error rates discussed above were obtained using a 
text consisting of independent letters (5-letter code groups). 
For a text which has more structure than random letters, 


whether through linguistic content, known message format, 
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PABLE Ii 


OPERATOR PERFORMANCE ADJUSTMENT FACTOR 
FOR SENDING SPEEDS 
(FROM LANE [3] ) 


RATE FACTOR 
(wpm) (dB) 
10 =5.0 
We -3.6 
14 -2.3 
Ls -1.8 
16 -1.4 
18 -0.6 
20 0 
ILS 1256 
30 Za0 


or increased semantic content, the human operator will take 
advantage of the structure to effectively reduce his average 
error rate. His error rate, however, for those portions of 

a message which exhibit uncertainty equivalent to independent 
letters, will remain at that for independent letters. Thus 
although his error rate for those portions of a message 

which have a high information content will not decrease, 

the transcribed message will be much more "readable," and 

the more costly errors will be much easier to locate in his 
output copy. As an example of "readability", consider the 
two messages shown below, each with a 10% error rate, including 
Spacing errors. The first message is of low information 
content and is readable, although with some difficulty; the 


second is a message with higher information content. (These 


ZA 





two messages were generated by using a random number generator 
to obtain the errors, which may not correspond to typical 


morse substituions. ) 


Message Il: 
THIS IS AN RX A9P LE OF EN G LI SH TE XT 
WITH AN ERROR RATE OF 10 PERCENK. THC 
ERRORS INCLUDE SPA CING BETWEEN LE TTERS 
AS WELL AS THE WP1D SPACE. MS CAN3 E 
Sew tlowt it woe ONr tH F LHRESHOLDO & 
ACC EPTABILREY AN D REQUIRA 2 SILAE 


DEEWSeG bax. tOOR BAD. 


Message 2: 
BM GEZRGE P BURDELL TO JOXN BUUYEL 
nLZsenaon Ss fF BEW YORK Br 
PSE C ALL NAMP HO NE NO 555 1233 AND 
TELL SIM WILL NOW DRR IVE KENNE DY 
Sven 3682 JU LELE NO 63 


WILL DEPANT FOX WAMH AT 231 9 12 JUL. 


The obvious point of this exercise is that average letter 
error rate alone is not a definitive measure by which the 
efficiency of a transcriber (either human or machine) can 
be judged, except for messages consisting of random letters. 
Secondly, it is clear that an automatic transcriber which 
does not use the message context and structure (linguistics, 


Semantics, format) to decode the received message will not 
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be capable of producing a transcript as readable as the 


human operator except for random letter texts. 
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iit LOVER BOUNDS ON ERROR RATE 


In this section, information theoretic concepts are 
applied to the problem of decoding and translation of the 
Morse Signal. Lower bounds on the performance of a trans- 
cription machine are obtained as a function of signal-to- 
noise ratio, keying quality, and decoder complexity. A 
channel model appropriate for studying the performance in 
this context 1s derived and its capacity determined. Source 
code models for the Morse code are also obtained, and together 
with the channel model, are used to derive a lower bound on 
decoded letter error rate. Although the average letter 
error rate, as argued in the previous section, 1s not a 
sufficient criterion for measuring the utility of a trans- 
Ccription machine in specific cases, it nevertheless provides 
a great deal of insight into the problem of determining how 
complex a decoder must be in order to approach the perfor- 
mance of a human operator. In order to obtain some intuitive 
appreciation of the Morse code as a source code, estimates 
of the entropy of a Morse-coded source are first determined 


under various assumptions about the source and the code. 


eee LTMATION OF MORSE-CODE ENTROPY 

The source entropy for a symbol-by-symbol decoder is 
obtained by considering the source to be an ensemble of 
Morse symbols each sent independently with probability equal 


to the expected relative frequency of occurrence of that 
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symbol. A decoder which is designed according to a model 
of the source as a Markov chain results in a source entropy 
calculated on the basis of that same Markov model. Thus 
various levels of model complexity result in corresponding 
levels of source entropy, as seen by the decoder. For 
independent symbol sequences the source entropy for an 


alphabet of size M is given by [4]: 


je (lal), Bhexer yey (ah) 


p(i) = relative frequency of occurrence of symbol i. 


For Markov sources the entropy is given by [4,p.68]: 


J 
H(u) = - £ q(i)H(u [s=i) 
i=l 
where q(i) = limiting probability of the state s = 1; 
K 
H(u/s=i) = - z Ba (eh Roe 2g Wet.) 
k=1 
P, (ay) eee eae Sie = 3) 1. 


i-.@. the probability that source letter ay is produced when 


the Markov process is in state j3 at time 2. 
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1. Independent Symbols 
Consider first the case of a source modeled by 
independent occurrences of the Morse symbols. In this 


case the entropy is 


= il = 
H ogP logP P logP., P logP.. 


~Paot Ais PAS dash ‘esp Sp csp ie) 


The relative frequencies of the symbols in random Morse 


are: 
Paot = .26, Peen 24, = sen =" 36, Beco = .14; 
and the entropy is: 
Meee 2O0100(.26))= .2410g(.24) - .36l10g(.36) - .14log(.14) 


1.927 bits/Morse symbol 


Since there are 1.76 bauds per Morse symbol, on 
the average, the entropy in bits per channel digit is 
Meet. 927/1.76 = 1.09 bits. 

2. First-Order Markov Process on a Symbol Basis 

The independent symbol model of Morse is actually 

only of passing interest since even the crudest of Morse 
models recognizes the fact that in Morse code a mark symbol 
(dot or dash) must always be followed by a space symbol 


(esp or csp), and vice versa. 
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A first-order Markov model has the following 


approximate transistion matrix and limiting probabilities: 


dou dash esp csp a1} 
dot 0 0 my Bee. 5216 
dash 0 0 ad ae ~24 
esp Pos, ~45 0 0 236 
csp we 5 5 0 0 nid 


Using the formulas given above for finding the entropy of a 


Markov source, 


H(u|js=1) = —.7log(-7) - -3log(.3) = .8813 

H(u |s=2) = -.7log(.7)- .3lo0g(.3) = .8813 

H(u|s=3) = .55lo0g(.55) - .451lo0g(.45) = .9929 
eenis=4)e—9=-5llog(-5) — .5log(.5) = 1.0 

Puen (. 26) (28813) + (.24) (.8813) + (.36) (.9929) + (.14) (1.0) 


-938 bits/Morse symbol 


(J. bes, Channel digit 


3. Second-Order Markov Process On A Symbol Basis 
A second-order Markov process of the Morse Code has 
the approximate transition Matrix and limiting state 


probabilities as follows: 


on 





mio 0 ©O O 1.55 O .45 O| 187 
mio )60UmC~«tt«C De SOS 073 
mo 60UOllCCOti«i 55 0 .45 0 173 
mo )6h0lCNté‘i‘CO M5 OS 067 
miee7 663 C«ikt(‘<é«C Set Cgeat 187 
m.97 .03 0 0 OOmO, 0 073 
~— | 0 6 2 . © 0) Pts 173 
ame |-0 Sp ie og Oe 067 


Again, using the formulas for the entropy of a Markov source, 


the entropy of the source for this model is found to be 


rG 
ll 


.858 bits/Morse symbol 


-.488 bits/channel digit 


4. Independent Letters 
The entropy of a source which produces equally 
likely independent letters from an alphabet of size 36 


(26 alphabet letters, 10 numerals) is 


H= =llog (702776) = 5.17 bits/ltr 


The average number of Morse symbols per letter is 7.27, 


resulting in an average entropy for the Morse symbols: 


H ele 1 «27 


avg .71l bits/Morse symbol 


.404 bits/channel digit 
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Pew English Text [5] 

For a model of an English text source, producing 
equally independent letters, the entropy is 4.76 bits/letter. 
Using the proper relative frequencies for the occurrence 
of each letter, the entropy is reduced to 4.03. A first- 
order model of English has entropy 3.32, and a second order 
model reduces the entropy to 3.1. A model which produces 
equally likely words of text has an entropy of 2.14. Thus 
1f a decoder which properly uses context, linguistics, and 
message structure can be designed, then the entropy of the 


Morse symbol for English text can be as low as 2.14/7.27 


~-294 bits/symbol 


Hoy Sives/ Channel digit 


In summary, then, it can be seen that there is 
considerable merit in using for design purposes a model of 
the encoded source based on independent or Markov letters, 
rather than a model based on a probabilistic description 
of a sequence of Morse symbols. (The various entropies 
are tabulated in Table III.) Given an optimal demodulator, 
a decoder which fully exploits the letter structure of the 
encoded source, then, can be expected to perform as well as 
the human operator for a source of independent letters. 

As discussed previously, however, any Morse message of 
Significant interest does not consist of independent letters, 


and the human operator easily exploits the decrease in 
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EABGE Lit 


ENTROPY OF MORSE CODE SYMBOLS 
AND CHANNEL BITS 


MODEL MORSE SYMBOL CHANNEL BIT 
INDEP SYMBOLS eo 2 / ir 09 
Hiro b=ORDER Bee es OOS 
MARKOV SYMBOLS 
SECOND-ORDER 2O06 -488 
MARKOV SYMBOLS 
ENDES SOURCE 2 ~404 
LTRS 
PNGiion LEAT 700 moe 


wou t= PROBSEIRS 

BNGLESH TREAT ~457 2260 
EPiRSE-ORDER 

MARKOV LTRS 

meNGLISH TEAT Roos v6? 


BOUL=PRKOB 
WORDS 


source entropy by knowing the context, linguistics, 
semantics, and format of the message. Conversely, any 
decoder which does not exploit this decrease in source 
entropy can never match the capability of the human 
operator, although it may perform well enough in some 


cases to be of value. 
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B. IDEALIZED HKM CHANNEL MODEL 

Since the objective here is to obtain lower bounds on 
error rate, and not an estimate of actual performance, it 
1S appropriate to consider an idealization of the HKM 
process, the detection process, and optimum demodulation 
in the presence of white gaussian noise. As such, the output 
of the detector would be input to a matched filter whose 
integration time is equal to the element duration of the 
Morse code being received. Exact knowledge of the baud 
length is assumed in order that the matched filter can 
remain in synchronism with the incoming signal. Obviously 
no decoder for HKM can ever have such information with 
certainty, thus this idealization represents the best 
possible demodulator which can never be achieved in practice. 
Secondly, the error crossover probabilities (dot vs. dash; 
element-space vs. character space) are idealized to be 
discrete probabilities rather than considering duration 
densities for these symbols; the word-space is included 
aS a source letter and the pause symbol is ignored for this 
analysis. Under these simplifying assumptions, the 
channel can be modeled as a discrete symmetric channel, 


as shown in Figure 3. 


ea 





BEeACE (0) 0 


Figure 3. Idealized HKM Channel Model 


In this model, the crossover probability 6 is related 
to the Morse symbol crossover probability by defining 46 to 
be the probability which yields the same average letter 
error rate as the symbol crossover probability on the 
basis of an average encoded letter. Since the average 
letter of Morse code consists of 7 symbols and 12 channel 


bits, 6 is defined by the relationship 
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where Be is the average sending letter error rate and ee 
is the corresponding symbol error crossover probability. 
It will be convenient to make the following definitions 


on the keying quality of a HKM signal: 


GOOD: E = .01 (P = .00143, 6 = .000837) 
S es 

BAR Fo = 1 (P =o 7o ow = se OCT.) 
S es 

POOR: E. = .25 (P,. = .0403, 6 = .0237) 


that is, a good sending operator sends the Morse symbols 
such that the resulting code stream consists of encoded 
letters in which 1% contain at least one incorrect Morse 
symbol; a fair operator sends with a 10% error rate; and a 
poor operator sends with a 25% error rate. 

The crossover probability ¢« is just l - Par where P 4 
is the probability that the matched-filter demodulator 
announces the correct mark/space decision. This probability 
memOobtained aS a function of SNR by computing E,/Nos where 
Ey = signal energy during an element duration and No = one- 
Sided noise spectral density. The error probability «¢ is 
then obtained from the performance curve for the probability 
of error uSing either coherent or envelope detection, as 
appropriate, followed by a matched filter [6]. 

The channel shown in Figure 3 may be converted to the 


equivalent binary symmetric channel shown in Figure 4 by 
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Eq 


0 = 0 


Figure 4. Equivalent HKM BSC 


defining the equivalent crossover probability, fag? 


_ = GON = e071) = 6 + 6 = 26c 
Clearly if 6 = 0 (perfect keying), then cag ee and if 
e = 0 (perfect demodulation), then E eg = 6. 


Since this channel is symmetric, capacity is achieved by 
assigning equiprobable input binary symbols, and is given 


by 


© = |] + Faq log E oq + (l - Sag! log (l - aa) 
Table IV gives the channel capacity as a function of signal 


speed and SNR for the KAM signal using envelope detection. 


SeeeecALCULATION OF LOWER BOUNDS FOR LETTER-ERROR PROBABILITY 
A lower bound average letter error rate is easily obtained 

by using the Straight-line Bound for a binary symmetric 

channel [4, p. 163]. To use this bound, it is necessary to 


know the number of codewords in the code, and the length 





TABLE IV 


HKM Channel Capacity as Function of Speed and SNR 


Speed SNR E/No 1-P. C 
Sem) eo (dB) (Envelope Det) 
50 
iD ieee 2x 10> ise 
9 ie DoS se ies 975 
6 8 2.7 x 10° 821 
3 ae sib se I 500 
0 é 2.3 x 10> ID 
30 
12 18 EON s ~1.0 
9 15 eg es am 998 
6 ie 3 a 947 
3 ta ok One 735 
0 eee iO 443 
20 
16 19.8 AOI 0 
9 16.8 <10°7 ~1.0 
6 lene ao: 992 
3 10.8 1.6 x 107" 882 
0 ed alone 598 


(in binary digits) of the codewords. Additionally this 
bound only applies to stationary block codes, requiring 
construction of an equivalent stationary block code for 
Morse, which in reality is a code which produces variable 
length word sequences. aeee an equivalent block code the 
appropriate relationship for the probability of codeword 


error, Pu, Pood Zen 7. : 
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N le k N-k 
Pee> [() - — Fy A ee Eo 
= k M ee k,m eq eq 
N 
REGU ee cuales); 
n=k+1 =a sel 
where 
N = codeword length 
M= no. of codewords 
CN 0) See eal 
se! = —_— 
A — 
mar, Tl 
0: k+l Sea N 
and k is chosen so that 
k-1l M M 
op A ee eer em em es 
a n = k,m k,m— k 
n=0 m=1 m=1 


This result for ae 1s for a block code with M codewords, 
each of length N bits transmitted over a BSC with error 
probability Bag’ The problem then is to construct a block 
code which is equivalent, in some sense, to the variable- 
length-codeword Morse code, then to determine the number of 
codewords and the length of the codewords for this equiva- 
lent code. Clearly the complexity of this equivalent block 


code will depend on how one chooses to model the human Morse- 


encoding process for the design of the decoder, i.e., encoding 


36 





symbol-by-symbol; symbol pairs, triplets, etc., letter-by- 
letter, letter pairs, 3-letter words, 5-letter words, etc. 
Additionally the codewords must be chosen so that the 
resulting encoded sequences are stationary in order to 
state that the statistical expectation represented by P 
is the same as the expected letter error rate (expectation 
over time). This stationarity can be ensured by requiring 
the encoded sequence to begin at a random point within a 
source letter [7]. Such a requirement is equivalent to 
stating that the decoder is not synchronized with the encoder 
on a letter basis; that is, the decoder has no a-priori 
knowledge of the beginning and ending of a letter of the 
variable-length word sequence produced by the Morse code. 

Consider first the construction of an equivalent block 
code for Morse which is assumed to be encoded as a symbol 
pair. Table V shows the variable-length Morse codewords 
for this code. An equivalent set of equal length block 
codewords, on the basis of equal average codeword length, 
is shown in Table VI. It is to be noted that some code- 
words cannot follow other codewords in an encoded sequence. 
For example, the sequence LOLOILIL cannot be followed by 
any codeword except those beginning with 10 since the 
sequence ll and the sequence 1111 are not allowable Morse 
sequences. 

In principle, the same procedure can be followed to 


obtain the set of codewords for any deSired codeword length. 
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TABLE V 


Variable-Length Codewords For Symbol Pairs 


Morse Symbol Channel Code 

nex 10 

-* Tak ske 

any 1000 

-v LELOOO 

As O01 

A= Our 

ae 0001 

US OOO 


Average No. of Channel Bits Per Morse Codeword: 4 


TABLE VI 


Equivalent Four-Bit Channel Mode For Symbol Pairs 


0000 1000 
0001 EO AEO 
0010 Oe 
0011 ABIL e)e, 
0100 Por 
wero 1 TAL TE 
Oe 1 


No. of Codewords: 13 


For sequence lengths greater than about 12, however, the 
sheer number of possibilities makes this procedure intrac- 
table. For obtaining codeword sets for an encoder which 


encodes combinations of more than one source letter at a 
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time, then, another procedure is used. Although this 
procedure does not obtain all the codewords in the equiva- 
lent block code set, it obtains almost all of them and 
thus represents a lower bound on the actual number of 
codewords. 

The average Morse code sequence is 7.27 symbols in 
length. For a Morse code, however, the sequence length 
in Morse symbols must be an even number (it must begin with 
a mark and end with a character space). By choosing an 
average of 8 symbols/character for the equivalent block 
code, and by requiring that the 8th symbol be a character- 
Space, then, it can be seen that it is impossible to produce 
a sequence of a Morse symbols which does not represent some 
character. It is also obvious that not all characters are 
represented by this code. Now, of the four symbols, only 
two are allowed in any one position of the sequence (Since 
space follows mark invariably and vice versa) thus the 
possible number of synchronous Morse sequences on this basis 
is ah = 128, and the minimum length of the codewords in 
Mimary digits is 8 x 1.76 = 14. To obtain the full set of 
nonsynchronous codewords, each codeword is shifted one bit 
at a time and a one or zero appended, if allowable, until 
no new codewords are produced. To illustrate, consider the 
Serenronous codeword 10111011101000. By right shifting and 
appending a zero and one respectively, the two additional 


codewords 01011101110100 and 11011101110100 are obtained. 


On the next shift, note that the sequence 0110 is not legal, 
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so only three additional codewords are obtained: 1010..., 
0010..., and 1110.... In general, those codewords beginning 
with a dot (10) produce eleven additional codewords, and 

the codewords beginning with a dash (1110) produce eight 
additional codewords. If M. = number of synchronous code- 
words, then M./2 = no. of codewords beginning with a dot 
(dash), so the total number of nonsynchronous codewords 


is given by 


M= 19 M./2 + M. aad Ole Mo 


Table VII gives the number of binary codewords (M) and the 
codeword length (N) for the encoding procedure of interest. 
MeeeeN < 12, M and N are exact, as computed by the first 
procedure discussed above. For N > 12, M and N are lower 
bounds obtained by the second procedure. Using these values 
of M and N, the lower bound on PS aS a mune til on. OL fed is 
obtained. This value for Be is the error rate over a code 
of M codewords, and for the case of single character encoding, 
is the same as the average letter error rate. For other 
cases of source alphabet models, however, Pe does not 
represent the letter error rate, since letters consist of 
more or fewer than one codeword depending on the length of 


the codeword. To determine the letter error rate, Eos 


consider the following arguments. 
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TABLE VII 


Equivalent Block Codeword Set Size And Length For Morse Code 


Encoder M N 
Symbol Pair as: 4 
3-symbol 815) 

Single letters (exact) 395 102. 
Single letters (bound) 1,344 14 
Double Letters 139,264 28 
3-letter words 227,020 096 42 


Case 1: Letters consisting of two or more codewords. 

For this case, the Bh erection of codeword 
error events per letter is binomial with parameter Po: 
Let m be the number of codewords per letter. Then the 


probability of exactly k error events per letter is given 


by ie) P.* wl a) and the probability of at least 


one error event per letter (i.e. the probability of a 


Mm 


Metter error) is given by E, = 1- (1 - P.) 


z 
Case 2: Codewords consisting of n letters. 

In this case, Fe is lower bounded by assuming 
that a codeword error event causes a single letter error 
within the codeword; then Ey = o/c 

Figures 5-7 show plots of the lower bound on 
average letter error rate, Eos as a function of SNR and 
keying quality for several levels of assumption about the 


Morse encoding process. 
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ve €) HUMAN OPERATOR (LAB) 


[Ref. 2] 


ZS HUMAN OPERATOR (COMM LINK) 
(Ref. 1] 


(2) SYMBOL TRIPLETS (33,6) CODE 


(2) INDEP LTRS (395,12) CODE 


7 8 g 10 ims ae as 14 B/No (dB) 


MeGURE 5. Lowen Bounds on Letter Error Rate for 
Morse Code ~- KAM Signal, Coherent Detection 
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() - SYMBOL TRIPLETS (33,6) CODE 





(2) - INDEP LTRS (395,12) CODE 


7 S 2 VO i 1 ilies 14 E./No (dB) 


FIGURE 6. Lower Bounds on Letter Error Rate for 
MigmeseeCoGgeey—etAl Staonal, Envelope Detection 
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iio (1)- GOOD KEYING 
(SENDING ERROR RATE = 13) 
(2)- FAIR KEYING 
(SENDING ERROR RATE = 108) @) 


(3)- POOR KEYING 
SENDING ERROR RATE = 253) 





7 8 2 10 ide 2 les 14 


FIGURE 7. bewer Bounds on hetter Error Rate for 
Hand-Keyed Morse, Envelope Detection, 
Random Letter Source 


B/No (dB) 





IV. A GENERAL MODEL FOR THE HKM SIGNAL PROCESS 


In this section, a general model structure which accounts 
for message context, sender operator errors, variation in 
date rate, and variability of element duration is constructed. 
Further it is shown that various special cases of this 
model result in processes for which optimum estimation 
algorithms and decoders have been treated in the literature, 
some from the point of view of optimal estimation theory 
and others from an information theoretic viewpoint. 

Fundamentally the model that is constructed is a sliding 
lock coder (SBC) with infinite memory. TaWaven instead 
of encoding the letters of the text into the Morse symbols 
either noiselessly or with a fidelity criterion, the 
encoding process is considered as a probabilistic mapping 
of the output of the SBC. The complexity of the SBC is 
determined by the degree to which the Morse message is 
desired to be modeled, from the simplest case of independent 
symbols to a highly complex syntatic and semantic model. 
While specific complex models of a Morse message are not 
developed in this investigation, the structure for imple- 
mentation of such models is provided by the general model. 
Thus the structure proposed represents a unified approach 
to modeling the Morse message from the simplest case to 


the most complex. 
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A. BASEBAND HKM SIGNAL PROCESS 

The desired representation of the discrete-time baseband 
HKM process is a sequence of 1's and 0's whose pattern of 
occurrence closely resembles that of a human operator sending 
a Morse text. By considering intuitively how a sending 
Operator may encode the letters of the text, the random 
variables which influence the human encoding procedure can 
be recognized. Figure 8 is useful for visualizing this 


process. 





Figure 8. Morse Encoding Process 


At some time k, one or more letters of the text, Rye 
are encoded into a sequence of code words a,, consisting 
of the Morse symbols. The human operator, however, does not 


always send the proper Morse sequence for a given sequence 
of letters; typical mistakes are insertions and deletions 
of one or more symbols (particularly dots), and substitutions 


Of one symbol for another (particularly word-spaces for 
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character-spaces. and character-spaces for element-spaces). 
Additionally the speed at which he is sending may vary over 
a period of time, depending on his alertness, proficiency, 
fatigue and the importance of the traffic being sent. 

The key converts these symbols into the 0,1 logic levels 
of duration consistent with the particular Morse symbol 
being sent. The length of time that the key is ina 0 or 
1 state, however, while determined principally by the Morse 
symbol being sent, 1S a random variable since the human 
operator cannot always produce repeatable, precise durations. 
The variability of the durations for each symbol, again, 
is dependent on the operator's proficiency, alertness, and 
individual sending habits. Consideration of these random 
influences leads to the model which is now developed. 


ree 


mM 
ro 
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JH. 
i 
px 
No 
uy 


the set of keystates; 


a, € {A.; im oe eo, ene set Of code symbols; 


—) 
mM 
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) 
ct 
SY 
¢)) 


set of source letters. 


Further, define the following finite state memory 


functions: 


oo 68) £o(x)78)_4)5 the memory associated with 
keying; 
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(2) Oy = Fifa rp y)s the memory 
encoding; 
mk = EL AL) the memory 
source, 
where 
By € {B. i; We, Jee |, ene Set OF 


et ee ee the Set of 


cn le 2 a | > the set of 
i 
states. 


associated with 


associated with the 


key memory states; 


encoder memory states; 


source (message) 


Then the state of the process at time k is svecified by the 


vector: 
ia = 
Zk au 
| <s [xp rap ry Py rt Ay] 7 
O 
[= 
where 
Ag al, 


For example, if £, counts the number of samples since the 


8 


last keystate transition, fy counts the number of symbols 
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sent since the last letter transition and fy records the 
previous letter, then a specification of the state vector 
gives the current key state, code symbol, and letter being 
sent, along with the amount of time the key has been in its 
current state, which symbol of the Morse code sequence for 
the letter is being sent, and the previous letter. 

To introduce the randomness associated with sending 
errors and variation in data rate, let a random control 
vector be defined which selects the Morse code sequence for 
the letter being transmitted, controls the instantaneous 


data rate, and the average speed of sending: 
mee, 2,2), the Set of control vectors. 


The complete state vector is now given by 


U,| = [x, a, a, Uy 


The probabilistic evolution of the states of the process 
will be fully specified when the following transition 


probabilities are determined: 


= = = = a 
ee a Bo er O, = LatSpiy ~ Snr Yea = Yor Se-1 = 2a 
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where 


ee coe RS is the set of all state values, 


oa 
ep) 
}. 
rw 
il 


and 
wee = 1, 2,..-Q} is the set of all memory states. 


This state transition probability matrix is now derived 
in terms of the components of the vector Sy - 
Let the evolution of the keystate, which is dependent 


only on its present and past inputs and its past outputs 


be described by the transition probabilities: 
(4) p(x,fa, a, , 8...) & Prix, = K.Ja, = A., ow . =A, 8, . = 
k'°k “kel “kel k eek jo ea) m’ "“k-1 


Similarly the evolution of the encoded letters ay. from the 
decoder is dependent on the present and past inputs to the 
encoder and on its past outputs, but it is also dependent 
on the history of the keystate, since the code symbol being 
keyed cannot be changed until the current symbol has com- 


pleted keying. The transition probabilities describing the 


encoder function then are given by: 


A _ _ 
Be 14, 8 Ap y Moy 8y2y) = Pria, = Aylu, = Uy. 
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The evolution of letters from the source is dependent on 

the history of the message text, but it is also dependent 
on the history of the encoding process, since the letter 

being encoded cannot be changed ener the current letter 

has completed the encoding procedure. The means ieaon 


probabilities for the source then are: 
4 a _ a 
(6) p(2 |a,_, O41) = Prit, = L,]a,_, = Mar %_, = ALI. 


mime control vector U, is modeled as a conditional Markov 


chain, conditioned on a, _,,8,_y,rAy_y) 


dependence of operator sending peculiarities and data rate 


d accounting for the 


on message context, message duration, traffic type, etc. 


The transition probabilities for this model are: 


Ir K-12 Bae *k-2) 


In terms of the abbreviated notation defined by expressions 
(4) through (7) above, the state transition matrix is given 


in terms of the components of the state vector Sy Dy: 


P(S, Up, Te 1Sp iy Yyeiy Spiq) F PUR By aR OM 2 AQ Vy 


8 i A 


al 


Sill 


Pele eae ie Seat. 


ee 





Bivoking the independence of appropriate variables argued 
in writing expressions (4) - (7), this expression reduces by 


the chain rule to: 


ms z | 
(8) p(s, My, TF, Uy, _ 7) = p(x, | a, By 7) P (BL | x, Beep? 


d 


Play |e, Wy Oy Apiy Bea) + PULA 7) 


OV Pc Seen) @ Bylo. 


B d ie 


PCO, Oy y Hy Bey MRA 


Now the expressions for the transition probabilities of 


Be hy hie are given by the following due to definitions 


mie — (3); 
oe if B, = £,(K;,/B,) 
p(B, 1x, 8.4) = 
0, otherwise 
1, ales A. = a Ee 
ere, % 24) = 
0, otherwise 
( 1, if M; = £,(L,,M)) 
P(AQ [a Ay y) 
0, otherwise 
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Thus the transition probability (8) is zero for unallowable 
transitions, where the set of allowable transitions is 
given by (1) - (3). The expressions for the state transi- 


tion probabilities (8), then, may be written as 
(9a) p(s, YU IYy_y I 4) = 


r 


P(x a, By yy) * Pla ee Wye Gy Agi Bey) 


P(A fAy iy Byig) © PMU, Up Ap oy Bey Aged)? 


where the set of allowable transitions is given by 
(9b) £ (s,,0, ,) © [£,(x,,B, .) £. la,,o, ,) £,(2,,a,.,)]° 
2g Se pera ca eo oR ket =X keen 


Expression (9), then is the desired description of the 
probabilistic evolution of the state of the HKM process, 
given in terms of the source (message) statistics, Morse 
encoding procedure, keying characteristics and data rate 
statistics. 

This model for the HKM process accounts for many effects 
which go into the generation of the key output logic levels. 
The extent to which the model accurately represents a Morse 
code stream is determined by the complexity of the memory 


manctlOons fy, Loa, Fe, and by the prover assignment of the 


O 


Senaitional transition probabilities. 
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For example, if the fy MiiCmreneeLousint Levent lv Comp lex 
and clever, the entire past context of a message may be 
accounted for in assignment of the letter transition 
probabilities. In the simplest case, the assumption is 


made that f, = 0, and uniform probabilities are assigned to 


r 
the letter transitions. The next level of complexity is to 


assume that fy = 2 allowing a Markov model for the letter 


k-1’ 
transition probabilities. Considerably more complex is a 
model which recognizes that certain sequences of letters 
are always followed by a known sequence in certain formatted 
messages. The most sophisticated model for this function 
1s one which models the structure of the Morse code message 
aS a natural language, requiring construction of syntatic 
and grammar-like rules which are used to parse the message 
into meaningful sequences of letters and words. Such a 
model would obviously require a highly complex £,- 

At the next level, that of encoding the letters into 
the mark/space durations consistent with the dot/dash/space 
Morse sequence for the letter, any level of sophistication 
and cleverness for the a function may be used, together 
Peeeneethne model for the vector control variable u. It is 
at this point that operator inconsistencies such as deletion, 
Substitution and insertion of Morse elements can be accounted 
Peewee Additionally, by proper construction of the fA BUnCELOn, 
One may also account for variations in weight (average 


dot/elem-space ratio), sending speed, and known conditional 
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relationships between the ratios of current to predecessor 
element durations. In the simplest case, the assumption is 
made that the operator always encodes perfectly and that 
his element durations are consistent. This simple case 
would apply to machine-sent Morse code and corresponds to 
fne Situation where u = constant, and fy = a,_y- 

At the key, the durations a, are converted into the 
0,1 logic levels of duration roughly equal to that produced 
by the encoder. The human, however, cannot always produce 
these durations consistently; thus, the time duration in 
a particular state will be random, with mean value roughly 
equal to the durations produced by the encoding process, 
and with a variance inversely proportional to his proficiency 
and concentration. There are, for example, certain con- 
ditional relationships which have been found to be true for 
almost every operator; in particular, inter-element dots 
are more consistently produced than beginning or ending dots. 

At this point, also, the effect of the type of key used 
by the operator may be accounted for. Hand-keys, mechanical 
bugs, and electronic bugs all produce different duration 
statistics for the same operator with the same message. 

The purpose of this research is not to derive sophis- 
ticated models for the f-functions, but to derive a result 
which shows in general, whatever model is used, how the 
concepts of context, message formatting, operator encoding 
anomalies, and operator "fist" modeling may be included in 


a unified framework to produce at the receiver an optimal 


=) 





estimate of the transmitted text. The extent to which the 
output translated text is an accurate reproduction of the 
transmitted message is clearly a function of the sophis- 
tication and accuracy of the model used. 

The results of this development of the model are summar- 


ized in the following simple theorem. 
Theorem 


Let Sy be an n-dimensional discrete-valued random vector 
with finite state-space: {Sj eta ae 


Let Uy be an m-dimensional discrete-valued random vector 


with finite state-space: {U,; le le a ee 


Let Le be an r-dimensional discrete-valued random vector 


with finite state-space: {A cela — ae ie re Sa are 


merime Ehe function £ : S, x £, > 2, such that 
O k kK k 


o, =f are realizations of the random 


k ee kok 


processes Syrlye respectively. 


), where s 


Let the probabilistic evolution of the Uy process be 


described by the following conditional Markov process: 


Let the probabilistic evolution of the S,~process be 
described by the following conditional probabilistic mapping 


of the U,-Markov process: 
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A = = = 
omit, O24) = Pris, = S.|u Ss. , =U 


Then, the output state s, of the HKM process described by 


k 
equation (9) results from a probabilistic mapping of the 
Markov control vector Ups conditioned on the entire past 


history of the output state. 
Proof: 


meest, it 1s clear that the function E records the past 


history of the output state Sy Since 


ee eed) = tg Skt (Sk K-2?? 


f(a, (Gh oS ooo 


Second, expression (9a) reduces by the chain rule to: 


P(s, Up [Up_y Soy) = PCS, [UR Upp Ly) + PM | Uy %7)- 


Corresponding the terms on the right-hand side with the Sys 
Uy processes described above, and expression (9b) with the 


f, function, the theorem is proved. 


Sit 





Corollary 


Let the function f, be invertible in the sense that 
Sy. = Pee (0) 1s uniquely defined. 

Then the output state Oy of the HKM process is a sliding 
block encoding of the sequence Sq1Sy So +++ Spe where the 
evolution of the Sy. process is described by the conditional 
mapping: 


4 _ a . 
ereieeq Seay) ~ Pris, = Si lu.) = Uy> o.) = An! 


and the U, process is described by: 


k 


A 2 = 
eer motes oe = Oye = U5re, a = Se 


Q 
ll 
=> 


Proof: From the main theorem, the state OL is describeable 


aS s 


oO. = Ei (sp rf (sy _ 478, (Sp_5: Ee £ifsy) giereds 


g 
which can be expressed in terms of a new function t as 


= t 
Oy ES, Sp iy  Spig r+ +8479) - 


Sys 





Now, defining D4 = Sor which is consistent with (9b) since 


0 is arbitrary, then ae represents a sliding block 


nol 


encoding of the sequence {s.}, 1 = Orpen kK. 


Now (9a) can be expressed as: 


Sy.) * P(Sy]Up 4 S27) 


P(Sy Uy |Upy 7) = POLLY 7 Oy 
and by the corollary hypothesis on the invertibility of foe 


& 


< = 
= pay [Up y 1 Egg 7 (Fr )) - 


1s already conditioned on o 


Bs |Uyeq Sai) 


But u so the additional 


k k-1’ 
=U 


conditioning provided by Ss. = Eos (O, 


thus (9a) 1s reduced to: 


1s exactly 
that provided by Ops 


p(s, Uy, [Uy 7 Op_4) = p(u, |U,_4 Op _4 01) : p(s, |U,_7 Opis 


which are the two processes hypothesized, proving the 


@erollary. 


Comments: The theorem and corollary are interesting pri- 
marily from a theoretical viewpoint. The main theorem 
actually does no more than place the intuitively developed 
model for the HKM process on a solid probabilistic founda- 
tion. In Section V, where an optimal estimator for the 
State of the process is derived through Bayesian techniques, 
the form of the model presented in the main theorem is that 


which is used. However, after the estimation algorithm has 
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been derived, it is shown that the optimal estimator has a 
trellis structure, which is not surprising in view of the 
corollary result showing an SBC interpretation. The block 
diagram shown in Figure 9 is useful for visualizing the 


evolution of the output state, Sy: 


B. BASEBAND HKM CHANNEL MODEL 

Although the channel model for the HKM process described 
in Section III was useful for obtaining lower bounds an 
error-rate performance, it is of little use in actually 
describing the physical processes which affect the reliable 
transmission of a Morse message. Consider the following 
Simplified model of the communication channel for Morse 
transmitted at HF. The keyer turns the transmitter on and 
off according to the HKM source. When keyed, the transmitted 
RF signal has amplitude C(t) at a carrier frequency w. The 
HF propagation channel introduces both additive noise (N(t)) 
in the form of atmospherics and interference, and multipli- 
cative noise (B(t)) in the form of fading and multipath 
propagation effects. At the receiver, the carrier is 
removed after being band-pass filtered and gain-controlled. 
After low-pass filtering and sampling, the baseband signal 
R= Xe CE by a Nyy where CL 1s the sampled, 


gain-controlled received signal amplitude; by is the 


1s given by z 


sampled, gain-controlled, low-pass filtered effective 
multiplicative noise component; and ny 1s the low-pass 


Pxrltered version of the additive noise. 
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The sampled version of the amplitude of the transmitted 


Barrier C, is a constant value while x, =l. During the 
period when a 0, the amplitude will remain constant at 
the same value as for ys es 1 for a large percentage of the 


time. However, it 1S not uncommon for the operator to go 
into a pause during which time he readjusts the transmitter 
power either up or down. These adjustments are usually 
made between messages, but also can occur during a short 
pause between letters. Thus the signal carrier amplitude 
is a random variable with a transition probability density 
which is conditioned on the memory of the HKM process and 
the current key state. In the simplest case, the model may 
be made conditional only on xy and Xpoy? 


sequence, the result that the carrier amplitude is allowed 


having, aS a con- 


to change randomly during every O-state duration. More 
realistically, one level of complexity greater allows the 


transition probability to be conditioned on By Such that 


the amplitude can change only when 8 indicates a pause. 


k-1 


The effect of transmitter power fluctuations at the output 
of the receiver is dependent on SNR and on the AGC employed 
for gain-leveling. For moderate to high received SNR, the 


effective c, observed at the receiver output stays relatively 


k 


constant because of AGC action. However, when noise power 
becomes a Significant portion of the total power controlling 


the AGC, then c, varies nearly the same as C Thus an 


k k* 


efficient model of transmitter power fluctuations must take 
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into consideration not only the actual power variations of 
the transmitter, but also the effect of the receiver RF, 
IF, and AGC sections as well. 

Consider now the multiplicative noise term, which has 
the observable effect of varying signal amplitude. If it 
arises because of relatively slow fading, then its effect 
will be cancelled by the combination of AGC and low-pass 
filtering. If, on the other hand, it is caused by fast 
fading (perhaps due to multipath), then the AGC cannot 
respond fast enough to keep the output signal-level constant. 
On an OOK signal, the effect is the same as if the trans- 
mitter power were changed during the carrier off-time. 

The term c,b 


eek 


power fluctuation, dependent on both the HKM process and 


then, represents an effective transmitter 


the HF channel, with the result that the marks of the HKM 
process appear to be transmitted with random amplitude. 
During the period of a MARK, the effective fluctuations 
are caused by the slow fading component with intensity and 
rate determined by the channel, the AGC, and the low-pass 
meter. 

In view of the above consideration, it is appropriate 
to model the apparent transmitted amplitude Y, as a condi- 
tional gauss-Markov process, dependent on both the HKM 


process, and the channel: 


(0a) y(k) = YF(s, o,_,) y(k-1) + T(s, 0,_1) w, (x) 
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where w, (k) 1S a zero-mean gaussian random sequence with 


unit variance; 


F(S, O,_}) is a function of the state of the HKM source; 
Ps, Op_4) IL el el upb alee Meelevercs leisy 


yY is a channel-dependent fading parameter. 


Now, Since the amplitude is observed only during a MARK 


period, the measurement equation is given by: 


(10b) 


where ny 1s the low-pass filtered, gain-controlled channel 
noise. 

Equations (10) represent the described HKM Baseband 
channel model, which accounts for the effects of fading on 
an OOK Signal and the effect of actual transmitter power 
fluctuations caused by the sending operator. 

Generalizing these intuitive concepts to a vector 
channel results in the following channel-measurement model. 


Consider that the output sequence s, of the HKM is observed 


k 


through the following channel and measurement processes: 


eee oe ce sy 7 TMS) OL) My, 


Zy = H(s,) Yu ny 
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where 


Vx 1s a p-dimensional state vector; 

Zy 1S a q-dimensional measurement vector; 
o(s, 4) is a p x p state transition matrix; 
H(s,) is aq X p meaSurement matrix; 

P (sy Op_4) 1s a p X p matrix; 

Wy is a p-dimensional plant noise vector; 
ny is a q-dimensional measurement noise 

VEC EOL 

Wy 1s Statistically independent of Wo for 2 # k; 

ny is statistically independent of ny fou 2. kk 

w, 1S Statistically independent of ny i 


k 


P(Yp) -P(w,) ,p(n,) are given probability densities. 


It is to be noted that this observation model, when con- 


ditioned on S10 is linear. Further if the probability 


k-1’ 
densities are gaussian, then the a Gonditional 
estimate of Vy given the sequence Za Ker, le 2as ey «6S 


given by the well-known Kalman filter recursions. 
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Ve erunoo oo eA tON PROBLEM 


The estimation problems of interest, based on the HKM 
source, channel, and measurement models, can be divided 
into two broad classes. The first results when the HKM 
transition and mapping Br obabalies are known a-priori 
for all k; the problem then is to find an optimal (in some 
sense) estimator for s, and/or u 


k k 
It will be shown that the desired estimator is not physically 


given noisy observations. 


realizable in general because it requires an exponentially 
expanding memory. In Section VIII, however, practical 
realizations of a suboptimal estimator are discussed, and 
it is shown that one can systematically come as close to 
optimal estimation as desired. The second class of estima- 
tion problems results when the HKM model probabilities are 
mewn Only to the level of an initial probability distribu- 
tion. The problem here is to estimate Sy and/or UL and 
the transition and mapping probabilities themselves. Only 
the first class will be treated here. 

In this class of estimation problems, the transition 
and mapping probabilities are specified, and the problem 
is to estimate the state of the system at time k, given 
the sequence of all past measurements 2* B {Zr Zoreee 2}. 
The state estimate of the system is given by the joint 
estimate of the output, control, and memory states S, Uy, Oy. 


The problem of obtaining an optimal estimate of the state 
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is approached in the traditional manner; that is, the 
(posterior) conditional probability distribution 

p(s, Uz a, |2°) is determined for all k, and a suitable 
optimality criterion is applied to this distribution to 
arrive at an optimal estimator. 

Using the Bayesian approach to the problem of obtaining 
the posterior distribution, a recursive form for the 
estimator is obtained. It will be shown that the resulting 
structure can be realized by a set of simpler, identical 
filters, operating on a tree or trellis. In the case of 
parameter-conditional linear-gaussian observation and 
measurement models, these "elemental" filters are Kalman 
filters. In case the observation and/or measurement models 
are not linear-gaussian, then the body of knowledge on 
non-linear filtering can be brought to bear on the design 


of these elemental filters. 


PeeGoLlIMATOR DERIVATION 

In the following it will be necessary to keep track of 
both the time index, k, and the state value indices for the 
states s, ¢ (S.J, uy, € (Ust, Oy 


notational burden which would result from the explicit 


3 {A,}. To reduce the 


notation of probability statements such as 


Pris, = S. |u, = Ba Bei ge Oa 


abbreviated notation will be used. The subscript k is the 


= Anis the following 
time index, and the superscript is the index of the set of 
state values. When k is used as a Superscript, it refers 


tO the time sequence of values, 0,1,2,...,K; @€.g., 
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Ha a ZyZo eee 2. Additionally the vector notation using 
an underbar will be dropped, with the understanding that 
all variables are implicitly vector-valued. In terms of 


this notation, the HKM signal and observation models are: 


(ll) Output State Mapping probabilities: 


mee Control State Transition probabilities: 
p (a2 fu™ of 1) S Pr{u, = U 
aie Lees c=) 


(13) Memory: 


oy 7 £, (Sx rg y) . Fy tS yr) 
me) Channel: 

Vig = §(sy oF y) ieee rise of 4) wy 
(15) Measurement: 

Zy. = H (st) Nae Th 


The well-known BayeSian procedure (see, for example, 


Lee [8]) for recursively determining the posterior density 
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(distribution) is given as follows. At time k-l, the 


mixture density: 


i 


hil 
10) 
K 
> 
i 
fant 
09) 
~ 
J 


( s. ur ,of .|z 
P\YR=-1 Pk-1  “k-1°k-1 


has been obtained. The density at time k, 


of a new measurement 2 iS given by Bayes' 


ee 


where: 


fx ia 
7) ply, Sy ae oy |z =) 


ply ee ae ot ly sy. ou 
yy Yk Sk Sk Ok! Yk-1 Sk-1 “k- 


ply s) a. of 
k-1l “k-1 “k-1 “k-l 


K 
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y | ee Gans ie 
| Ply, Sp up 12° “)plaly, s 


after receipt 


rule: 
k-1 i Q 
Ply, SK UR oy 
=a 
Z ) 


q ,,k-l 
peje 


dy, 


k-1 
[2 ) Keak 





The desired state posterior probability distribution 


then is obtained from (16) by integrating over Y;? 


Ld oti - | ij 2._k 
(19) p(s, uz o, | 2 = ; Ply, S, Uy Oo, | z ) dy,. 
k 


so= dh 


Substituting expression (18) for v(z ls a ee 1G) 


k 


expression (19) becomes: 


kL 


ij 2 ij 2) kel 
Tigi, Se Ue eZ) PW, Se He IZ) AY, 


encores 

teed : 

me kM 1? _ z J ( st y on |) ey sti of Zh) 

ij yk k “k °K peek 2k Wk Wk Ok Yk 
k 


and the problem is to obtain a result for the integral over 
Yy in terms of the prior density at time k-1l, and the model 
transition probabilities. 

The first term in the integrand, p(z, ly, si ud oy Zoot). 
is readily determined from the measurement equation (15) 
and the density of the nolse, P,(n,)- In the case of ny 
a white sequence, the density is given simply by: 


a P (2, l¥y a = p,(z, - H(s,)y,)- 


ie 9 eee? 
(21) p(z, ly, S, Uz, I, 2 
The second term in the integrand is given by (17) in 
terms of the prior density and the transition probabilities. 
Rewriting the mixture densities in (17) in terms of the 
component conditional density for Vn and the discrete 


sescrlibutions for s expression (17) becomes: 


k UK OK 
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ae toe 
(22) ply, 35 ire ov |z 1) = 
een eee eT m q k-1 
z | PWM Se Oe Oe Sen Sean ee Ue 
ning eet 
k-l 


n m Ci k=l 
- PUY, 7 [Spey Un Mari? 7) 


n m q k-1 
CS oe cs SS 


Now since S, U, Oo, are independent of a the density 


on line (c) above is not changed by writing: 


n k-1 gon q _k-l 


m or 2 eo] m : 
fe) PUY St Yen ei?) = PU ats Sy ay iz 


Also, by virtue of this independence, the expression on 


line (b) becomes: 


¢ 


itt S| eee n m Ce 
BS Me IY Sa nn R-1” 


a 


e ee eat m q 
y= BUS, Ue HIS Ya Seep) ° 


Semoaning (a) & (e), substituting (f) for (b), and rearranging 


the terms of (22), the expression becomes: 


que 


(d) 





io joe oe 
p(y, SU, | 2 ) = 


nmq 


Carrying out the integration over areal and noting that ve 
iommot dependent on U, SF, Spiy Upiys the desired result 
for expression (17), in terms of the prior and transition 


probabilities, is given by: 


Lj 8) ke 
mee ply, s, uy o, (2) 


oe). ee ™m q n ™m q k-1 
: P(sy Up Op [Spy Uy Spy) P(Sp_y URW, SR 12 7) 


a) Ol eget! 
PY, IS %ayF2 7) 


The integral in (20) is then given in terms of (23) 


and (21) as: 


ij 2 _kel i 5 2,_k-1 _ 
(24) Tae S$, U, Oo, 2 ) ply, S, uz o, | 2 ) dy, 
k 


a eee m q n m q eo 
Si P(SK Up Of /S~_y Uy Ff 7) PCS_y Und %-1!% 


i TC 2h 
a Sy) Ply, |S~ S772 7) dy,- 


Yk 
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The resulting integral over Vy in the above expression is 


Seen to be a likelihood function since 


i i k-1 3 k-1 
| P(2l¥ Sq) PUY, IS Mp2) = Plays OY IZ). 
zis 


Denoting this integral, then, as the likelihood, 


ig A | i i oq _k-l 
5) : piz ly, $,) Ply, 1s, %%_,72 ~) dy,, 


k 
the posterior conditional density (20) is given by (24) 


& (25) as 


at Laon m n m q k=l, ig 

ee uo | sy Uy Fe PPS) Go ale 

ij 2k _ | 
(26) p(s o,|z-) = een m nom 4 | k-l,,1q 
k °K Vk fe p(s uy, [Sy W477 iP Sy Yip ay l2 AY 


This is the desired result for the recursive calculation of 
the probabilities of the states S, Uz, Oy given the measurement 
sequence 2X, In terms of the model transition probabilities 
(ll) and (12) and the memory function (13), the transition 


probabilities are computed as: 


m 


aL q e 
ees) 


J n 
BIS, Uy %1S,-1 2 


th joe J se q ated 
p(s) luz Up] Oy_1) p(up lu, _y = 1 


cs) 





along the allowable transition paths specified by 


For each memory state and control state value at time k-l, 


the transition probability p (us Jue ot ) 1s specified 
k'“k-1l “k-1 : 
meet 2) for all j,m,q. Then for each j,m,q, the mapping 


ae 1 ey seat q . : 
probability p(s, up U,_7 %%- 1) iS given for all i by (11); 


the value for OL Pomrounce ror each 2,q pair by (13), and 
pea 1s computed by (25). The posterior probabilities are 
then computed by (26) and the state values and their 
probabilities are in place for the next recursion. 

Clearly the ability to carry out the recursion (26) 
exactly depends on whether or not the likelihood (25) can 
be found in closed form. Such a form can indeed be found 
for the linear channel and measurement models (14) and (15) 
in case the noise ny is white and gaussian, as will now be 
shown. 

First note that the densities involved in the expression 
for the likelihood (25) are both conditioned on specific 
realizations of Sy and Opa namely S. = S3 and oe ae Na 
The first density p(Z, 1, =o) feolven by (21) tor the white 


noise sequence; for the white gaussian sequence, (21) becomes: 
mye p(z,ily 5) =|. (cA a H(st) y (k) =N HGS (kK) ,R) 
eek Kk n’“k k Zi, gaa Tad a 


where N, (m,V) is the gaussian density with mean x = m, 


variance V and p, (n,) = No (OR. 
k 
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Consider now the second density in the integrand (25), 
cies K= 1 = oan _ 
p(y, |S, Op_,:2  ~), the s, o,_, - conditional one-step 


prediction density for area PuLOnCmenemreccn Specttied by Ene 


k-l. The path label, then, at time k, resulting from the 
extension of the path labeled he at time k-l, is 


Ay = iG) Now 


ee pay oD | iq ._k-l 
Ply, ls, Of 4:2 7) = , Oe lee Gh Cre aul 
k-1 


bg 12 ee coal 
Upon le, Omi 92) Shr 


and since the Sy ae pair is uniquely embodied in 


el 15 Ee! | a ae 
= £ {SE cee and y,_, given z om ence Se ncen &1o4 


Sys the above expression becomes 
eee oo SLC | em Stl 
ie) ply, |o,;z2 ~) = | Ply, |¥y_y Se %-2 
Ge 
Eee ey 


for each oy along a path given by 


Now when the o-conditional density for the initial 


value of vie 1S gaussian and the re or conditional 


es 





channel model is linear gaussian, the above density (28) is 
gaussian for all k, and the mean and variance of the density 
is given by the Kalman filter recursions. 
Specifically, this density is given by 
= 


s Wy ic = ~ 
mo Pty, |9, 2 7) = By Mi fad Mg) Mpg Mg) 


where 


and the recursions for Yala? and Vila lb? are given by 


the remaining Kalman filter equations: 


“Aw 


Pape [yar ge? 7 thy) 2 WEIS) yy pay (4g) 


ale 3) = (1-G, (A,)H(S,)) V (A,) 


k[k-1°"2 


AL AL = al 
A) )H (S,) [H(S,)V Ae es! (S;) vee lke : 


G.fA,) = K|k-1'"2 


Ve lk-1' 


Substituting these expressions (27) and (29) back into 


(25), the integral to evaluate becomes: 
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F 
icin ee kk Ny, Yk [k-1 Me) Va [ew a e498: 


The evaluation of this integral is a basic exercise in 


integration of gaussian densities and is given by [8]: 


k ee ee tT. -1 
629 ) Lig = ¢ Zach che Exp t-yl2y py (Ay) 1 Py 
where 
Bree gs ee ISG) Yeti Ay) 
af I 
V ALS) SARS (US Se (A ya CS.) + ; 
ae Q i’ “k/k-1'"2 z Re 


eye fae LEMENTATLION STRUCTURE OF ESTIMATOR 

mine Structure of the filter realization density (26), 
together with the likelihood calculation (29), is that of a 
tree with nodes given by the past state trajectories and 
with branches labeled by the states of process. For each 
transition, 1.e., each path extension to a new node, the 
likelihood of the transition is computed from the Kalman 
Meeeer recursions along that particular path. The likeli- 
hoods are multiplied by the transition probability for that 


path extension, and by the previous path probability. The 


Te. 





updated path probabilities are then obtained by normalizing 
these products. The tree structure showing the evolution 
of the path labels according to a particular function is 
illustrated in Figure 10. 

The next stage of this structure would obviously 
contain N x I, nodes where N is the number of possible 


k 


states S. and I, is the number of nodes at stage k. Thus 


k 
the number of nodes expands exponentially. However, in 
case the function £. depends only on a finite portion of 
the past trajectory, then the tree structure eventually 
becomes a finite trellis at the stage which accounts for 
the definition of foe resulting in a trellis appropriate 
Bemeevyiterbi decoding. If the function £5 has infinite 
memory, then obviously some approximation technique must 

be used to keep the number of nodes finite. One such 
possible approximation 1s to save only a given number of 
nodes at each stage, most likely those with the highest 
posterior probability. Another scheme which is possible 

is to save only enough nodes at each stage, the sum of 
whose posterior probabilities is less than or equal to 

some specified number, Eye” This latter method is attrac- 
tive from the standpoint that for high signal-to-noise 
ratios the number of nodes saved would be small, while for 
low SNR, the number saved would be larger. This scheme 


therefore would have the attractive feature that the 


processing load would automatically adapt to the SNR. 
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FIGURE 10. 
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fa BolIMATOR ALGORITHM 

The following algorithm implements the estimator given 
by equations (26) and (29). For a practically realizable 
estimator, some rule which saves only a finite number of 
paths as discussed above must be used at step 8. 


Step 0 Initialization: 


k = 0 

T° = MN (number of joint Sy, ry states) 

a (a). i= es De ae arbitrarily specified 
p°(i) = 1/MN, i = 1,2,...,1° 


Step 1 Obtain indices for new nodes: 


a) k=ke#it1 


bye hor dq = 1,2,. a! 
m= 1,2, M 
mo= 5b. 2; N 


(igh), 


co Gere ey ae + (m-l1l)M +n 


Step 2 Label each new node: 


NOGrecach nis Mm, cq, Obtain 


aS (3) = £18 ,4°7*(q)) 
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Step 3 


Step 4 


Vo 
k{k-1 


Obtain transition probabilities: 
For each n, m, q, obtain 


k-1 
Pek (mato =e Some O wie, 1) =P ReUee ie. fh 
( q) (SLU Ugrlg ) PRIDE L OG AG 


Calculate ps for each hypothesized transition 


mq 


sgl 


(Some obvious indices are omitted): 


Por Cach fn, ™M, G, Compute: 


a) Kalman step: 


w~ 


ae: gall a 
Ye {q-1 09? = o(S_ A (q)) Yeni tk-1 ‘@? 


can. & T 
Vigna (J) = G (Sq MCD) gpg (GET + US, 


ke an. T = 
a ee cae Co eH +R! 


~t 


~e 
wn 


Yi {e lJ) = Yc jena 9) + Sy 2) R19) 


ea eu 
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(q)) 





Step 8 Update number of paths 


(k) Cia) 


I = NMI 


GO. co step 1. 


It 1s to be noted that the computations cannot be 
Seerried out “in place"; that is, estes) cannot be stored in 
the same locations as me are until all the a* (4) have been 
computed. Similarly, the Kalman filter means and variances 


must be stored in separate temporary locations until step 5 


1s completed. 


Eee LoCUSSION AND RELATION TO PREVIOUS RESULTS 

In the language of the literature on non-linear filtering, 
the present result represents an extension of previous 
results in system identification problems to the case 
where the unknown discrete system parameter S}. is the result 
of a probabilistic mapping of an underlying memory-conditional 
Markov process. Previous investigations have treated both 
the case where Sy 1s a Markov process [10], [11], and the 
case for S, an unknown time-invariant parameter [9]. The 
present result reduces to these results for the appropriate 
modeling of S,- 
Case I: Markovian Parameters [10] [11] 

In this case, Sy is a finite-state discrete- 


mame Markov chain with transition matrix 


men. (k) } a {Pr [s, = S. | = S,1t. The n-dimensional, 


Skel 


S-conditional system dynamics are given by: 


1) 


82 





eee) Myo * PS MG 
and the m-dimensional measurements are 


Z1 = H(S,)¥, + ny 


The random variables w n, are zero-mean independent 


ke 

gausSian, and independent of the Markov chain S,- 
In terms of the generalized model developed above, the 

memory function f, (13) is specified, for this case, by 


pk 


[S, Splyp ote S)! and the output state mapping 


on 
probabilities (11) are independent of the UL - ovrocess 
and given by {ps4 (k) }. The system dynamics and measSure- 


ment equations, in terms of the realization of the Sy = 


process are then given by 


ee oe ay PSS, Sp oy), 


= H{ +n 


4 Sy. On Ge k 


The posterior measurement-conditional path probabilities 
are given exactly by equation (26). The likelihood equations 
mo) for a are obtained in the same manner by replacing 


H(S,) with H(S. A_) where Me 1s a path specification obtained 


iq 
through the memory function: Ao - a . eae ae 


The posterior probability for the parameter s then is given 


kv 


by summing over the paths: 
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P*(s,) A Pr[s, == S;)| = ; Ps 
ge 
where 
k A _ ie 
: ial Pr[s, S, iO) = Ag lz ] 


The CME or MAP estimate may then be obtained: 


N ie 

CME: Sy = £ s. P (S.) 

; sh 1 

1=1 
MAP: S S) pX(s.) = max Bacar 

1 
Case II: Unknown Time-invariant Parameters [9] 
For this case, since the parameter Sy does 
not change, the memory function is given by Sn Saar with 


an initial probability given by py a Pr{s. = S.l, tom 12. 


The dynamics and measurement equations are 


Pee eg | oy) My 


N 

ll 
ry 
Q 

wn 

< 
Ee 
iS 


Again the posterior path probabilities for 
S, are given by equation (26). The likelihoods are determined 
from equation (29), but since there is no path branching, 
the Kalman filters all operate in parallel, each on a 


different conditioning S;- 
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Additionally, since the parameter transition probabili- 
bies (k > 1) are given by Pr[s, = S. |S, _4 = $5] SF © Sos 
the sum over the previous paths, nmg, in equation (26) 
becomes a Single term for each path extension, and (26) 


reduces to 


k iia (S;)L5 
Pe ({(S.) = m= 1,2 N 
1 Nees k 
ee: (Sal 
j=1 : 
which is Lainiotis' result [9]. Note that since there is 


no branching of the paths, the exact ootimum solution for 


this case is realizable. 
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VI. A PRACTICAL HKM MODEL 


While the results of the preceding theoretical develop- 
ment show how optimum estimation of the state of the HKM 
process may be performed, it remains, of course, to specify 
the parameters of the model. In this section, specific 
values for the model parameters are derived and it is shown 
in principle how increasingly complex models may be obtained. 
While the specific model derived in this section is one which 
considers the letters of the text to be independent and 
equally likely, it is shown in principle how this model may 
be easily extended to include contextual message information 
as well. 

The parameters to be determined are given by equations 


C9) : 


ES Uy, |U,_7 O24) and £ (Ss, Opi) 


that is, the state probability transition matrix and the 
recursive memory function. These expressions are given 


in terms of the components of s by equations 9a 


kK! AK OK 
and 9b: 


) 


Keystate transition matrix: p(x, [ay Ur, Bri oy 
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Morse symbol transition matrix: pla, |2, Uy Oy Any Bx-7) 


Text Letter transition matrix: p(k, [Ay _y A.) 


@entrol transition matrix: P(U, juy_y Mp By Ay}? 
Keystate memory function: £2 (x, 7B, 4) 
Memse Encoder memory function: EY fay Oy) 
TEXT memory function: E(k AL _y) 


Thus the problem is to determine reasonable values 
for the probability assignments (9a) and to construct the 
recursive functions (9b) which account for the portion of 


the process which can be described deterministically. 


Pewee SE YSTATE MODEL 
The simplest usable model of the evolution of the keystate 


would be the simple Markov model described by: 
P(x, |x,_,) 2 Prix =j|x,_,=i]; i,j = 0/1 
k '’k-1 k k-1 ; : / 


This model suppresses any dependence of the transition 


) 


probability on current and past Morse symbols (a,,a,_) 


and speed of transmission (up), and limits the dependence 
on past history of the keystate to the immediate past, Xp _y° 


Such a model would have the memory function: 


Sr 





no KE Pknl? =X 
The four Markov transition probabilities Pr[x,=1|x,_,=1], 

Pix, =1}x,_,=0]. Pr [x,=0|x,_,=0], Bry sre 0 |e etal can be 
obtained empirically by determining the relative frequency 
of the states ll, 10, 00, Ol ina large ensemble of actual 
hand-keyed Morse messages. Clearly these probabilities 

are dependent on the sampling rate. As a simple example, 
consider the possible realization of an HKM sequence as 


illustrated in Figure ll, with the resulting transition 


probabilities for this sequence given in Table VIII. 


Figure ll. Example Of Sampled HKM Process 


TAB BE VLit 


faanstiTom PrGbabllities For Tllustrative HKM Process 


State No. of Relative Probability 
Transition Occurrences Frequency Estimate 

iy 1 30 30/33 mou 

ir 0 3 3/33 202 

0/0 16 Gye 84 

0/1 3 By 2 FAS 
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If the sample rate were different from that illustrated 
then obviously the relative frequency of each of the 
transitions would be different; this dependence on sample 


mate 1S shown in Table IX. 


TABLE IX 


Transition Probability As Function Of Sample Rate 


Sample Rate State Transitions 


(relative to 


illustration) ial 1/0 0/0 0/1 
Freq Prob Freq Prob Freq Prob Freq Prob 
1X SOW 33) Shh 67 cme. 09 16/19 .84 3/7 1S elo 
3p i327 lo 40 SVN = JUS V7 Ome 37-10 eS 
2X Gs7o6 .95 37608 05 Say/Sheh A 3/ 38°08 


This artificially induced dependence of the kKeystate 
transition probability on sample rate is undesirable from a 
modeling viewpoint since, in reality, the continuous-time 
HKM process generated by the sending operator has no such 
dependence, and it is intuitively unsatisfactory to require 
the statistics of the sending operator to fit an arbitrarily 
selected time scale. 

This dependence can be removed by normalizing the time- 
scale to the element-duration, whereby instead of measuring 
the sample rate in samples per second, the sample rate is 


measured in samples per duration in elements. Consider, 


89 


then, the following expressions for describing the keystate 


evolution: 


A ae = 7 


g _ |°k 
k-1 a 
Me 
oy = Opy (1 7- X 7 X_y + 2X, Xp _4) + ] 


where it is seen that the recursion for dy counts the number 
of samples since the last zero-one or one-zero keystate 
transition. This description then conditions the keystate 
transition probabilities not only on the immediate past 

and the number 


keystate x but also on the data rate u 


k-1" k! 
of samples, Ors that the key has been in al or 0 state 
Since the last transition. 
Now if oy is given in samples with a sampling interval 
A 
tT, then Ty = oy 


m@emtast 0 to 1 or 1 to 0 transition. If Uy, 1s given in 


tT is the amount of time (in seconds) since 


terms of words-per-minute, then the element duration for 
this rate is ry é (6/ 5)" °x (l/u,)-. Thus the normalized time 


for this data rate is given by: 


SOs bles 1G 
- _ 3% et. 
ce G 
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This description of the keystate transition probabilities 

is clearly more satisfying since it depends only on the 
individual sending operator's rate of transmission and keying 
characteristics, and not on the sample rate. 

The model is still not complete, however, since it does 
not allow for dependence on the type of Morse symbol being 
keyed, clearly for dots and element spaces, transitions 
between mark and space states occur more frequently than 
for dashes, character spaces, word spaces, and pauses. 
Additionally, these transition probabilities depend to some 
extent on the previously keyed symbols, with the degree of 
dependence being a function of the type of key used. For 
mechanical bugs, a series of dots separated by element 
Spaces is sent by simply holding the paddle in one position, 
creating a string of symbols with virtually equal durations. 
When sending a dot/dash combination, however, the element 
space duration is determined by the operator's dexterity and 
not by a mechanical device, so the variability of this ele- 
ment space duration is higher than that for the repeated dot 
sequence. A similar effect occurs when the key is an elec- 
tronic bug, although the variability of repeated symbols 
1s even less than that for the mechanical bug. The same 
type of dependence on past symbols has been noted even for 
senders using a telegraph key [12] [13]. It has been found 
that the primary effect is that of reduced variability of 


element-space durations when the preceeding symbol was a 


oul 


dot (a detailed analysis of the effect of key type on 
keystate statistics may be found in [13]). 

While the keystate transition probabilities have been 
noted to be dependent on the preceeding symbol sequence, 
this dependence is clearly a second-order effect when con- 
ditioned on the current symbol. In the model developed 
here, then, these second-order effects are ignored and the 
final exvressions for the keystate transition probability 


model are given by: 


P(x, Ja, U, 8,4) = Prix, =j [a,=A,,U,=U,,,8)_1=B, 1 


ak: 
K x 
kK 
>, = O.-, (L- % - X,_) + 2x, x, _4) ee 


In terms of the normalized time scaled, the transition 


probabilities are Pr[x,=]j|x,_,=1,a,=A_,r,,T,_,]- For 


example, the probability FB ea = 56), Sclove pee t] 


i — 
= ge kT 1'Tk-1 
is the probability that at time k, the key will remain in 
state 1, given that the operator is sending a dot, that his 


average element duration is r and that they key has been 


1! 
in state 1 for t element durations. Clearly if t is close 
to zero, then this probability is nearly 1; and similarly 
meet > 2, then the probability is small. 

An equivalent expression of this probability is the 


probability that the duration T! becomes duration 


k-I 


BZ 





+ T/L, Simncecat <a. — Le then TOL = 7 +T = 


k *K-1 


+ t. This probability can be determined from the den- 


t 
a 
1 


sity of symbol durations, conditioned on speed r, and symbol 


k 
type. 

The modeling of the symbol duration densities has been 
a topic of considerable interest among investigators working 
on the Morse decoding problem. In the past, because of lack 
of sufficient empirical data, these densities have been 
assumed to be truncated gaussian or uniform [2][14]. A 
recent intensive modeling investigation by Technology Services 
Corporation [13], did indeed demonstrate the not surprising 
result that when normalized for speed variation, the density 
of each symbol duration, averaged over several operators, 
approaches the gaussian density. For individual operators, 
however, the densities are far from gausSian, and no single 
normalizing technique was found which would allow for para- 
metric estimation of the individual densities. Thus, the 
problem of parameterizing the symbol duration densities of 
individual Morse operators remains open. Indeed, the evidence 
supported by the data accumulated so far indicates that 
estimation of these highly individualistic densities must be 
accomplished on-line using a combination of parametric and 
non-parametric techniques. 

It is not the purpose of the present research to delve, 
yet again, into this density estimation problem, but to show, 
whatever, the proper density, how it can be used most effec- 


tively for Morse transcription. For the purposes of the HKM 
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model developed here, then, a parametric symbol duration 
density is hypothesized and justified on the basis of intui- 
tive arguments. Traditionally, the local speed of the Morse 
signal in wpm is defined as 1.2 times the reciprocal of the 
element duration (in sec), averaged over 10-20 mark-space 
pairs. A histogram of the normalized symbol duration (actual 
duration in seconds divided by average element duration) is 
then taken to be an estimate of the shape of the density 
function for that symbol. The new approach to be considered 
here is to hypothesize an instantaneous speed of transmission, 
defined to be the speed at which a single symbol is sent. 
The instantaneous element duration (baud) is likewise defined 
on an individual symbol basis. The effect produced by 
assigning appropriate probability densities to each results 
in the same description for an average 10-20 mark-Sspace pair 
segment as does the traditional approach. The reason for 
hypothesizing such parameters is simply because it is more 
intuitively satisfying to propose the existence of individual 
symbol statistics whose average behavior duplicates the 
observed empirical behavior, rather than to propose that 
the statistics of each individual symbol are identical to 
the observed average statistics. Although this distinction 
is a fine point, it allows greater flexibility in estimating 
the keystate transition probability with fewer parameters. 
Consider then the following hypothesized random 


varlables: 
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instantaneous speed of transmission 


K 
I 


> 
Il 


instantantous element duration (baud) 


and let dot and element-spaces have duration = A; dashes 
and character spaces = 3A; word-space = 7A; pause = 14A. 


Then in terms of the actual symbol duration, ae 


d 
aul 
m 


where m= 1, 3, 7, 14 as appropriate. 
The normalized symbol duration, in terms of A andr is 


given by: 
Aer: 
OF = (=) Ar 


Note that while A is well-defined in terms of a measurable 
quantity, r is arbitrary. However, it is convenient to 
define r such that its value is indicative of the actual 


Speed: 


Although this expression determines the statistical behavior 
of en through its dependence on the random variable A, 


Clearly it does not restrict the freedom to assign appropriate 


as 





statistical description to the other moments of the random 
variable r, independent of one Stqerstres Of, <A. 

Consider now the random variable Das and note that mg , 
is the normalized symbol duration (in elements), given that 
the symbol was transmitted at rate r. A density for MA + 
conditioned on r, then describes the keystate duration 
random variable, normalized for speed. Let this random 
variable be described by the Laplacian density (double~sided 
exponential) with mode m and parameter a, as illustrated in 


Figure 12, below. 





(=5/6 mAr) 


Figure 12. Laplacian Duration Densities 
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In terms of the speed r: 


Get (5/6 mAr — m) . Md , a 


p(mo,/r) = 


oo) (Ie = By AS mAr) | mo, > m 


The parameter a and coefficient c are to be chosen such that 
Pr[lo, > 2) = Pr[3¢o, < 2] = .0135; that is, the probability 
of error in sending a dot for a dash or an element space 

for a character space (and vice versa) is arbitrarily 
selected to be 1.35%. This symbol error rate was found to 
be the average error uSing optimum separation thresholds for 
55 samples of hand-keyed Morse studied in the TSC analysis 
[13]; and since the densities are conditioned on the instan- 
taneous speed, the normalized optimum threshold is halfway 
between m= 1 and m= 3. On this basis, then, a andc are 


determined as follows: 


| 
“ 

i 
ke 
<> 
a, 

K 
Qu 

oO- 


Pr[lo, > 2] 
2 
a (1 - >,) 
= ce da oan 
Z 
=c/ae- 
Likewise: 


oF 





Pr{39, ace | C/o e * 


The probability density requirement gives the other 
equation needed: 


oO 


_ f piney do, = ] 
1 Cc 
a(o,- 1) a(l- >,) 
| ce a>, + ce a>, = 1 
GAC) a=) 16/6) ik 


Solving for a,c gives, for dots, dashes, element spaces, 


character spaces: 


Using the same procedure for word space (m=7) and pause 


(m=14), the values for the densities are: 


word spaces: oe) asl, c= .90 


pause: a= ao 07 c= .45 
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Having constructed the duration densities, the speed- 
conditioned keystate transition probabilities can now be 
determined. 

Let dD, be the current normalized keystate duration, 
i.e., the amount of time (in terms of instantaneous element 
duration) since the last 0 to l or 1 to 0 transition. Then 
the required probabilities are Prlo, ea Dy + E/Xp Ayr TE Oy > Dol, 
where ¢€« is the normalized sampling interval given by 
e = T/A. It is seen that this expression gives the transition 
probabilities in terms of the probability of extending dura- 


Lon Da for one more sample interval. The conditioning 


parameters provide the normalization coefficients to be used 


fOr p(mg,/r)- Given the appropriately scaled density then, 
Pike De oye Df 
_ = TS A— oOo 
geen = Pote/o, 2 DO! = Prid, > Dy 


mace > 0, sO Dore > Dos and the joint probability becomes: 


PaO Doterd, 2D | = Pri¢ 


A 


and so the conditional probability is given by: 


Pr[o, a Dote] 


PETG, 2 Dote/On 2 Pol = BETS, > DAT’ 


V 


where Pro, a Be Pr[o, 2 Ditel are computed as follows: 


oS) 





CO 


pr[g, > Dote] = | p(o,) do, 


eee 
-a (D +¢€-m) 
se . JO) eres 
& a 
a(D +¢€-m) 
1- $e = ; D+e<m 
O — 
Similarly: 
Pale, > DJ = | p(p,) do, 
O 
-a(D -m) 
( i. : D>m 
2 -— 
a(D_ -m) 
| 1 - Se 7 , D < m 
Oo=- 


Forming the quotient of these probabilities in the appro- 


priate ranges gives: 


es D2 
a(D +¢-m) 
a. ° D < 
2 o — 
-a(D -m) : 
+ > = 
Prig¢, > Y E/ 9) a DO! se O D_+¢e 
1-=xe 
é P Dae 
1 a(D_-m) O 
 jLl=-xe 
\ 2 


| Vv 
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The above expression then represents the keystate transition 
Probability for the "transitions" 1-1 and 0-0, conditional 
on the current symbol type, data rate, and length of time 
already in state 1 or 0. The probabilities for the transi- 
meomest-QO and 0-1 are found, obviously, by subtracting from 


tlie 


B. SPEED TRANSITION MODEL 

The random control vector u, may contain components 
which model operator sending peculiarities such as random 
[miseertions of extra dots, slurs, character splitting, or 
any other feature of interest which controls the manner in 
which encoding takes place; it is not limited to speed con- 
trol alone. However, the peculiarities mentioned above 
are highly individualistic and little modeling of these 
peculiarities has been done. It is conjectured that such 
modeling will have the same fate as that of attempting to 
obtain a general parametric model of the keystate duration 
densities; that is, no general model will be found, and 
such modeling will require on-line estimation techniques. 
For the purposes of the HKM model developed here, these 
peculiarities are ignored, and the only component of the 
Somntcrol vector Uy, considered is the instantaneous speed r. 

The speed transition probabilities are developed on 
an intuitive basis seasoned with experience and the results 


of the TSC study on observed hand-sent code speed variability. 


In that study it was found that, on the average, hand-sent 
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code exhibits a speed difference of about 2.5 wpm between 
segments of 10 mark-space pairs, but that it is not uncommon 
to observe a speed difference of 8-10 wpm between segments. 
Now observing that the speed transition probability expression 
| Ye 7 Ay Buy Ap~-1), allows for 


conditioning on the entire past history of the state of the 


of the HKM model, p(u 


HKM process, it can be seen that this transition probability 
may take into account such items as message duration (for 
modeling the effect of operator fatigue), the actual text 
itself (for modeling the effect of speed changes due to 
sending different types of text material), or any other 
feature which may have an effect on sending speed. The only 
conditioning to be considered here, however, is the immediate 
past speed Wop the past history of the encoded output, 


and the keystate duration 86 Let 


k= 1! k=1° 
R. € Peete te CU, siean integer); that is, a set of 
discrete speeds in wpm between 10 and 60 wpm. The following 


model for p(u, lu, 47°) 1s proposed: 


If 8,_, # 0 (no change in keystate), then 


No 


PCW, [Up 7 ey 8RLy) 
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That is, the speed is not allowed to change except when the 
keystate changes from 0 to 1 or 1 to 0, no matter what the 
previous symbol is. For By = 0, the speed transition 
probabilities are made conditional on the type of Morse 


symbol just completed: 


For ty + indicates dot, dash, e-sp: 


Pr{u, SJR ae 2i fu, = R 


5 7th OR es ee ie Me! 


where i= 0, l, 2. 

This assignment of tansition probabilities allows the 
speed to change by increments of 0, +2, +4 wpm according 
to the probability ag Wee ge 

For a), 7 indicates c-sp, then the increment remains 
the same, but the transition probability assignments may 
be different. 

EOr oe indicates word-sp, the increment is increased 


=o, and for M1 7 indicates pause, the increment is 10. 


To complete the model, the p.. ( ) remain to be selected. 


sak ies ih 
These probabilities, which were selected on the basis of 
speed differences reported by TSC (and on intuitive appeal), 
are given in Table X. 
Note that the absolute average speed differences for 


the four categories correspond roughly to the ranges observed 


iy TSC. 
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TABLE X 


Symbol-Conditional Speed Transition Probabilities 


Symbol Just Speed Increment/Probability Average 
Completed (wom) Increment (wpm) 
dot, dash, e-sp —4 -2 0 2 4 TERS 


Wee Wee «2 ok 


c-sp 4 -2 0 2 4 220 


w-Sp = S83) Se 4.0 


pause a0) See. tO 20 0 


C. MORSE SYMBOL TRANSITION MODEL 

Mae symbol transition probabilities, conditional on the 
letter being sent, are obviously either zero or 1, since 
knowing the letter specifies the code sequence. If the 
model is only a first or second-order Markov model, then the 
symbol transition probabilities for various types of text 
may be computed. Since it is desired to test the performance 
Of the estimator as a function of modeling complexity, these 
probabilities were estimated for both a first and second 


order model and are given in Tables XI and XII, respectively. 
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TABLE XI 


First-Order Markov Symbol Transition Matrix 


a A av Ww 

0 0 noo 36 .07 .02 
= 0 .o4 Ef 07 02 
a So) 45 0 0 0 0 
a 5 5 0 0 0 0 
W a) 5 0 0 0 0 
D & 5 0 0 0 0 

TABLE ALI 


Second-Order Markov Symbol Transition Matrix 


heme is A av W Pp 
Fe 55 45 0 0 0 0 
~ 45 0 0 0 0 
Ww 5 0 0 0 0 
p 5 5 0 0 0 0 
-. oe 25 0 0 0 0 
=" 5 45 0 0 0 0 
ay “f 5 0 0 0 0 
=p 5 5 0 0 0 0 
‘ 0 5 .581 .335 .069 .015 
A= 0 0 .54 1.376 .069 .015 
~ 0 (mec ee OG 2 O12) 008 
Vv 0 (msec r 062.012 9.004 
We 0 (ee oeo062).012.. .003 
w- 0 (SC OG20e 2 005 i 
D. 0 0 .95 .04 .009 .001 
p- 0 0 .95 .04 .009 .001 
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The encoder memory function, fae may be constructed to 
record the previous symbol for the first-order model, or 
the previous two symbols in the second-order case. In case 
the symbol transition probability is made conditional on 
the letter being sent, there is no need to record previous 
symbols for use by the encoder. As a minimum, however, the 
fonction fy must record the previous symbol for use by the 
speed transition probability, since it has been made 


conditional on this symbol. 


wee LEXT LETTER TRANSITION MODEL 

For equally likely independent letters, the letter 
transition probabilities are uniform, and the only con- 
ditioning necessary 1S on A._4 SO that when Oy indicates 
the end of a letter, the letter transition is allowed to 
occur. During the period when ty does not contain a 
c-sp, w-sp, or pause, obviously the letter transition 
probability is zero. This case of equally likely letters 
is the highest complexity modeling actually coded and tested 
in this investigation. It is clear from the theoretical 
error-rate analysis of section III, however, that the 
largest payoff in terms of increase performance is to be 
found in more sophisticated models for this transition 
probability and memory function. This fact was recognized 
early by Gold [12] in his study of the Morse decoding problem, 


in which he developed the MAUDE algorithm for decoding of 


the demodulated Morse waveform: "The conclusion is inescapable, 
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therefore, that for the automatic reception of a language 
encoded by even a simple process like Morse code, a machine 
must have some knowledge of the language if it is to 
approximate the performance of a man." 

The major difficulty, however, in modeling the message 
text is that the type of text is not constant. The letter 
dependencies are highly variable among such traffic types 
as call-up, response, chatter, formatted messages, plain 
language messages, code groups, etc. Here again, then, 
it is conjectured that the only real solution is to perform 
on-line modeling of this transition probability and memory 
function. Clearly a straightforward application of proba- 
bility estimation techniques, while feasible, is simply 
not practical in this case. For a third-order model, the 
storage requirements would be on order of B67 =e, OO, Ono 
words, just to store the transition probability matrix. 

The £, function would require 3G locations to keep track 

of the three prior letters. Although some reduction in 
memory could be accomplished since some letter combination 
rarely occur, it is evident that the storage requirement 

is large. The most promising technique for utilizing the 
decrease in source entropy may be one similar to that for 
recognition of speech using a linguistic statistical decoder 
[15], with appropriately modeled linguistic elements and 
using an appropriate channel model [16]. If a suitably 


flexible grammar for a set of Morse messages can be defined 
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then perhaps a form of syntactic decoding is in order [17]. 
If the semantics of the message are well-understood then 
one possible approach is to use a dictionary look-up to 
form the f, function, on a word basis. This technique for 
English text messages is under investigation by an ARPA- 
funded MIT project, but a final report of the results has 
not yet been issued. The Army Research and Development 
Agency is currently studying the possibility of defining a 
grammar for a specified set of Morse messages for use in 
syntactic decoding. These kinds of techniques for dynamic 
on-line construction of the £, function and estimation of 
the transition probabilities are clearly the only realistic 
methods of reducing the entropy of the text sufficiently 


to obtain error rates comparable to that of the human 


Operator, in any situation except for random letter groups, 
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VII. A PRACTICAL HKM CHANNEL MODEL 


The general baseband HKM channel model developed in 
Section yy is given by the channel and observation 


equations (10): 


ag SONS Co se 0 oy Ramee a ech 


where Zy 1s the sampled output of the detector. The specific 
model to be considered here requires the parameter y and 
functions F, I, H, to be selected such that the resulting 
model has the following features: 
(1) The noise process represented by ny 1s a zero-mean 
white gaussian process, with known variance Ry. 
(2) The amplitude hie 1s observed only when xy = A; 
that is, during the signal on-time (MARK), so 


Ehake H(s,) = H(x,) =x 


k Ke 
(3) During a MARK, the fading amplitude process obeys 


a linear gauss Markov process given by: 


Sm elie «Vy 


where the parameter y and the variance of v, are 
selected to represent the fading observed at the 


detector output. 
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(4) The observed effective transmitted amplitude is a 
random variable which obeys the following time- 


varying linear gauss-Markov process: 


ig Nese fare Ea eee ees CH, een) 

where F and | are selected such that: 

(a) During a MARK the transmitted amplitude 
remains constant. 

(b) During a space the amplitude can change, the 
amount of change being dependent on the type 
and duration of the space. 

(5) It is assumed that the detected signal has been 
gain-leveled by an AGC, so that the average detected 
output power 1s normalized. 


The parameter selection and function construction process 


for each of these features is discussed below. 


eee ee OBSERVED NOISE PROCESS 

Since the noise process observed at the output of the 
detector is the result of envelope detection of a narrowband 
gaussian process, the resulting process is neither zero-mean, 
gaussian, nor white. The sampled process, however, has 
independent noise values if the sample interval Tt satisfies 
where B is the bandwidth (in Hz) of the 


BPF’ Ber 


band-pass filter preceding the envelope detector, provided 


fet /2 B 


that also the bandwidth of the low-pass filter of the envelope 
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BPF* If tT is less than this 


value, then the sampled noise is correlated, and a model 


detector 1S greater than 2B 


which accounts for this correlation would theoretically 
provide for better estimation. Several techniques are 
available for such modeling, [18] and should be used if 

the noise 1s correlated. Clearly if t is selected purely 

on this basis alone, then the assumption on independence 

can be satisfied. There may be, however, other competing 
constraints on the selection of tT, and although the value 
selected may render the independent noise assumption invalid, 
1ts effect can be minimized by selecting it as large as 
possible within the other constraints. 

The bandwidth of the bandpass filter is selected on the 
basis of the largest signal bandwidth expected. The highest 
code-speed under consideration for this processor design 
was selected to be 50 wpm, which has a minimum pulse duration 
(MARK) of 24 msec. The specific filter implementation was 
selected to be a cascade of two single-tuned resonators, 
Since this combination has a respectable ratio of noise- 
bandwidth to 3-dB bandwidth of 1.22 [19], and can be coded 
With relatively few multiplication per sample. For this 
filter implementation the optimum bandwidth as given by 
Peotmix (|19] 1s .613/.024 = 25 Hz, and has only .56 dB 
of loss in SNR compared to the matched filter. Although 
such a narrow bandwidth greatly increases the SNR of a 


Signal in a 4 kHz receiver bandwidth and effectively eliminates 





most interferers, it is clearly too narrow to accept signals 
which have a significant carrier instability due to chirp 
or drift. Since it is not uncommon to observe carriers 
with a chirp on the order of 50 or so Hz, the bandwidth 
required is on the order of 100 Hz. There is obviously a 
strong motivation, therefore, to investigate filtering 
techniques which would adapt to the chirp, since a 100 Hz 
wide filter represents a loss of 6 dB compared to the 
optimum bandwidth of 25 Hz. Motivation for adaptive 
filtering techniques is also provided by the fact that at 
20 wom the optimum bandwidth is only .613/.060 = 10 Hz, 
thus there is a 10 dB loss in SNR compared to the optimum 
bandwidth when using a 100 Hz filter. 

For this investigation, since the primary emphasis is 
on optimum demodulation and decoding techniques, a fixed 
100 Hz band-pass filter is used. For this bandwidth, then, 
the sample rate may be selected to be 200 Hz, with a resulting 
sample interval of 5 msec. Since this quantization is con- 
Sidered adequate for representing the minimum duration 24 msec- 
long pulse of the 50 wpm code with sufficient precision, 
then t is selected to be 5 msec., resulting in independent 
noise samples. 

Since approximately 5 msec. is the largest quantization 
allowable for adequate precision in representation of the 
code symbols, and since adaptive techniques for the band- 


pass filter would result in narrower bandwidths, the assumption 


WAL 





on independent noise samples would be violated for this 
case, requiring a model which accounts for correlated 
noise, if optimum techniques are to be pursued. 

Although the zero-mean assumption on the output noise 
process is violated, a zero-mean process may be approximated 
by estimation of the mean and subtraction of it from the 
detected output. Estimation of this mean value also pro- 
vides an estimate of the noise variance, Ruy which has been 
assumed to be a known value throughout. (Again, although 
techniques are available for modeling in the case of unknown 
noise intensity, the simplified approach taken here is to 
use the estimate of R, as if it were the true value. It can 


k 
be seen in section IX, Table XIII, that the resulting pro- 


aN 


cessor is relatively insensitive to Rus as long as Ry. is 
within a rather large range of the true value.) Estimation 
of the mean noise level relies on the following relationships. 


Let x, be a white gaussian random process with one-sided 


density Ny? input to the BPF; let Z, be the output of the 


Le 


envelope detector, with Bsr > B RDF as illustrated below: 





Figure 13. Envelope Detection Process 
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Then, from Davenport [20], 
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and the approximation to a zero-mean process is a 7 Hh 
Implementation of such an estimator is described in 
Seeulon VIII. 


The assumption of a gaussian process for n, is clearly 


k 
violated since the output of the detector has a Rayleigh 
density in the absence of a MARK, and a Rician density when 
Signal is present. Thus not only are the statistics not 
gausSian, but also they are correlated with the signal when 
a MARK is present. By choosing to ignore the higher-order 
moments of the density (greater than 2), the resulting 
estimator based on this assumption may not be optimal in 
the sense of providing as good a conditional-mean estimate 


as possible, but it will still provide the minimum-mean-squared- 


error estimate. 
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B. THE MEASUREMENT FUNCTION 

During the period when si 0, the transmitter is 
turned off and it is not possible to observe the amplitude 
which is being used to transmit the MARKS. Thus only 
noise is observed during this period, and by ignoring 


the correlation between signal and noise when signal is 


present, the measurement equation is simply: 


C. FADING MODEL 

The effect of fading can be observed during a MARK 
period, with the maximum fade rate being determined by the 
band-pass filter/dectector bandwidth, under worst-case HF 
channel conditions (rapid, intense fading). For typical 
values of fading rate on the order of 1 Hz, the fading 
Parameter y, for a 5 msec sampling interval is given by: 


_ e7 (+005) (27) (1) 97 


vf 
The intensity observed at the output of the gain-controlled 
detector can be approximated for the typical 1 Hz fade rate 
by noting that during a 1 sec fade period the amplitude 
can change by about 3 dB for a typical receiver AGC circuit. 
The intensity for this range of change, i.e., the variance 


one Vy ms about: 
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Var (v,) 2 [2/(1./.005)]* = [2/200]? = .0001. 


As discussed earlier, in Section IV.B, when no signal 
is present, the effect of fading is that the subsequent MARK 
appears at an amplitude which differs from the amplitude 
of the previous MARK in such a way that it appears as if 
the MARKS of the signal were transmitted at a random 
amplitude. Because of this effect, these mark-to-mark 
variations are lumped together with the variations caused 


by an actual change in transmitted power. 


D. APPARENT TRANSMITTER POWER VARIATIONS 

In addition to the Mark-to-Mark amplitude variations 
discussed above, the actual transmitted power may vary. 
Usually this effect is most prominent when working with a 
communications net, since the received power of each of the 
transmitters on the net will usually be different. These 
changes usually occur after a pause (during which one net 
member has signed off and another is preparing to sign on); 
however,, 1t 1S not uncommon for a new net member to sign 
on during a time duration for a word space or even a character 
Space, especially if net discipline is good. It is assumed 
that changes do not occur during an element-space or a mark. 
The following model accounts for these effects: 

ape FOr o > mark: 
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Q, = Var(v,) = .0001 
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Part (a) is just the fading model for Marks discussed 
above. Part (b) expresses the statement that no change in 
amplitude may occur during an element space. Part (c) 
states that, at the end of an element space the transmitted 
amplitude has not changed, but a variance of .01 is asso- 
ciated with the amplitude observed on this transition. The 
value .01 is obtained by considering that at the end of an 
element space transmitted at 50 wom, the fade may have 
decreased the amplitude to one = .89 of its previous 
value, thus a variance of (1 - Rog) - = .01 is appropriate. 
Part (d) states that for any other space, while the variance 
associated with the transmitted amplitude is zero, the 
amplitude is assumed to decrease exponentially with time 

at the rate (.98); and Part (e) allows a subsequent MARK 

to appear with amplitude determined by a gaussian random 
variable of variance .25. (The construction of the I(-) 


function is implied by the assignment of variances to the 


various Oo) 
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VIII. IMPLEMENTATION OF HKM STATE ESTIMATION ALGORITHM 


The implementation of the estimator algorithm (Eqn. 26, 
30) for the signal and channel models just described is now 
presented. In the context of this model, estimation of the 
keystate is referred to as demodulation, estimation of the 
Morse symbol is termed decoding, and estimation of the text 
letter is called translation. The estimation algorithm 
Mrerms jJOlnt demodulation, decoding and translation, i.e., 
Saeco cSstimates are not made in a serial fashion; rather 
the structure of the code is used in an optimal way to aid 
in demodulation, and the structure of the text is used to 
aid in decoding. From this viewpoint the algorithm repre- 
sents a "correlator-estimator" [21] technique in which a 
sequence of all possible keystate transitions are hypothe- 
Sized and correlated with the incoming signal, and the most 
likely sequence is output as the best estimate. From the 
viewpoint of coding theory, the algorithm represents a 
tree decoder in which all possible paths of the joint state 
evolution of the process are examined and extended in an 
optimal way. If the memory function were dependent on only 
a finite portion of the past history of the process (usually 
a good approximation) then the tree decoder reduces to the 
Viterbi decoder. As implemented herein, the decoder is 
most like the M-Path algorithm described by Haccoun [22], with 


the path metric being the product of the likelihood of the 
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received signal along the path and the transition 
bility for the path extension. If the decoder is 
to save only one path, then the decision-directed 
linear filter investigated in [2] is obtained. 
Proceeding now to a detailed description, the 


is presented in terms of the Fortran code used to 


proba- 
constrained 


optimal 


algorithm 


implement 


it. Subroutine PROCES is the main calling routine which 


takes an input signal sample each 5 msec, along with an 


estimate of the noise power, and calls the appropriate rou- 


tines in order. The first routine called for each sample 


point is TRPROB, which computes, for each previously saved 


path ending at node J, the probability of extending the 


path to new nodes which are labeled to indicate the joint 


State (keystate, element state, letter state, data rate). 


These probabilities are computed using the model and equa- 


tions described in the previous section. Next, subroutine 


PATH labels the new path extended to each new node with: 


(1) the number of samples since the previous keystate 


transition along that path; (2) the data rate of the new 


node; (3) the identity of the element state at the new 


node; (4) the identity of the letter state at the 


new node. 


These labels are obtained from the memory function Ee with 


arguments provided by the identity of the path being extended 


and the identity of the new node to which the path is being 


extended. Subroutine LIKHD is then called to compute the 


likelihood of the input signal sample for each transition 


under the hypothesis that that particular transition occurred. 
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LIKHD maintains an array of Kalman filters for computing 
this likelihood as given in Section V.A by equation (30), 
and using the specific channel model described in the previous 
section. 

Having obtained the new path identities, transition 
probabilities, and likelihoods, the posterior probability 
of each new node (i.e., each path extension) is computed 
using equation (26), in subroutine PROBP. Next, routine 
SPROB computes the posterior probability of each keystate 
(0,1) and each element state, and the conditional mean 
estimates of the data rate, by summing over the appropriate 
nodes. The MAP estimate of the keystate at this point is 
the demodulated signal, and the conditional mean estimate 
of the keystate is the (non-linear) filtered version of 
the detected signal. Also the evolution of the MAP esti- 
mator for the element state may be observed at this point, 
and represents the decoded message with zero decoder delay. 

The next function to be accomplished is the saving of 
paths for the next iteration. It is at this point that the 
estimation algorithm becomes sub-optimal, since it is 
clearly not possible to save all paths at each stage of 
iteration. A technique which yields a high probability 
that the correct path will always be saved obviously pro- 
vides the best sub-optimal performance. Several techniques 
for selecting the paths to save are available. The 


. Simplest idea is to always save a fixed number, say 


ek 





ex It was determined empirically, however, that, while 
this technique does indeed give a high probability of 
Saving the correct path, most of the time the posterior 
probabilities of many of the saved paths were very low and 
need not be extended at all. At the instant of a keystate 
transition, however, the probabilities become more uniform 
and it iS necessary to save all the Mee paths. The next 
technique then was to save only enough paths such that the 


total probability saved was equal to P SubJEeCE tO Ee 


ejone ! 
constraint that M ax 1s not exceeded. Another technique 
suggested by [22] is to make the number of paths saved a 
function of the probability of the highest probability path, 
such that when the highest probability path has a very high 
probability, fewer paths are saved. Either of the last 

two technigues has the aiececiame feature that the decoding 
computational burden is adaptive to the signal-to-noise 
ratio and the data rate, and the first of these was selected 
for use, with the additional constraint that at least one 
path for each element state is always saved. This algorithm 
is coded in subroutine SAVEP. 

Also in subroutine SAVEP, the saved paths and their 
identities are renumbered in order of decreasing probability 
and a pointer array 1S maintained to identify the previous 
mode from which the saved path was extended. Additionally, 
the parameters of the Kalman filters are reindexed to be 


consistent with the new path indices. After action by 


SAVEP, then, the arrays are ready for the next iteration. 
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Before proceeding to the next iteration, however, the 
trellis of saved paths is updated with the new saved nodes 
and connected to the proper previously saved paths by using 
the pointer array. Decoding and translation are accom- 
plished within subroutine TRELIS by operating on the trellis 
of saved paths. Decoding is done by finding the one node, 
at sufficient delay, from which all successor paths origin- 
ate. If no such single node exists within the trellis for 
a Maximum delay of 200 samples (1 second delay) then decoding 
is obtained by reading the node at delay 200 which is 
connected to the current highest probability path, and 
all other paths not originating from this node are deleted 
from the trellis. Since the text has been modeled by a 
source of equiprobable, independent letters, translation 
is done by a simple mapping of the decoded Morse symbols 
into the proper letters and numerals. 

There are three auxiliary processing routines for pre- 
processing of the signal, intended to simulate the operation 
of a receiver, bandpass filter and envelope detector, along 
with the routine to estimate the noise power in the detected 
Signal and provide a zero-mean noise process. Subroutine 
RCVR converts the incoming signal at carrier frequency WS 
to a frequency of 1000 Hz using an 8 kHz sample rate, and 
provides a single-pole 500 Hz BW band-pass filter. Sub- 
routine BPFDET implements the 100 Hz bandwidth band-pass 


filter by a series of two digital resonators centered at 


LEAS. 





1000 Hz, and accomplishes envelope detection. The low pass 
filter of the envelope detector is a 100 Hz bandwidth 3- 
pole Chebyshev filter. Subroutine NOISE estimates the noise 
power present during a space condition by obtaining the 
minimum value of the envelope detected Signal over a period 
of 240 samples (1.2 seconds). This minimum value 1s ob- 
tained at each 5-msec sample point and averaged. The 
average is then scaled, with the scale parameter selected 
empirically, to provide the estimate of wae the mean value 
of the envelope detected output during a space. This esti- 
mate is subtracted from the envelope detector output to 
provide an approximation to a zero-mean noise process; RN, 
the estimate of noise power in the detected output 1s then 


given by Te 
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IX. SIMULATION RESULTS 


The Fortran coded algorithm just described has been 
programmed on a PDP-10 time sharing system, along with a 
Signal simulation routine to generate a Morse code message, 
a routine to simulate transmitter effects, and a channel 
model routine. The text generation routine selects letters 
and numerals either at random or from a pre-defined text 
file. The corresponding Morse code sequences are generated 
by a table look-up, and the durations of each element are 
randomized according to a selectable probability law. (How 
the results presented here, the probability law used was a 
truncated gaussian such that no element is ever less than 
16 msec or greater than 360 msec in duration. The variance 
was selected to give the error crossover probabilities on 
an element basis to correspond to the good, fair, and poor 
operator defined in section III.B.) The waveform generated 
by this process is used to modulate a carrier of frequency 
Wo Ss 4 KHZ, which is simulated by discrete-time process 
sampled at 8 kHz. This carrier 1s then subjected to the 
fading model (VII.C) and white gaussian noise of selectable 
power is added. This received carrier 1s then input to 
the receiver, bandpass filter and detection routines dis- 
cussed previously. The output of the envelope detector, 
adjusted in level by subroutine NOISE, is then input to the 


main processing algorithm, PROCESS; the demodulated, decoded 
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and translated results are presented on a CRT from which 
hard copies may be obtained. 

The overall objective of the simulation experiment is 
to determine how well the finite-path suboptimal estimator 
performs relative to the optimal estimator. Since it is 
not possible to code the exact optimal estimator due to 
exponentially expanding memory and computation, the lower 
bounds an error rate derived in Section III are used as a 
basis for comparison. Secondly the performance of the tree 
decoder (the term tree decoder will be used to refer to the 
suboptimal finite-path estimator) relative to other simpler 
techniques is to be evaluated. Finally the performance of 
the tree decoder as a near-optimal demodulator for Morse- 
code is to be obtained and compared to the performance of 
the linear matched filter with integration time equal to 


the basic element duration. 


Pee lhe IDEALIZED KAM TREE DECODER 

The idealization assumptions made in Section III for 
deriving the lower bounds on error rate can be obtained by 
constraining the estimation algorithm to have path branching 
only at the possible transition times of a synchronous KAM 
Signal, and by making the input a true baseband Morse wave- 
form with added white gaussian noise and no fading. This 
experiment was run in order to determine the validity of 
the lower bounds derived there and to obtain a data base 


for evaluating the sensitivity of the tree decoder to 
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non-ideal conditions. The results of this experiment are 
shown in Figure 14 for the three cases of first-order and 
second-order symbols and independent letters. Clearly 
under these ideal conditions the lower bound is very nearly 
obtainable. 

Also shown for comparison are the results of demodulation 
accomplished by linear matched filtering with decoding 
accomplished by thresholding the durations at 2T, where T 
is the basic element duration. These results show that the 
demodulation provided by the tree decoder is clearly superior 
to the matched filter, and that the independent letter 
model is of sufficient complexity to obtain near-optimal 
demodulation. 

Next, the effect of lack of synchronization was obtained 
by removing the branching constraint on the paths, but 
still keeping the same idealized input Signal. The results 
are shown in Figure 15. By comparing with the results for 
the synchronous case, it is obvious that at the lower SNR's 
the performance is peace 

The next effect to be investigated was the sensitivity 
to noise statistics in the estimator's lack of knowledge 
of the true noise power. These results, shown in Table XIII, 
indicate that the estimator is relatively insensitive to 
incorrect estimates of noise power within a reasonable 


range. 
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TABLE XIII 


NOISE POWER EST SENSITIVITY 
(20 wpm KAM) 


SNR Est Used by Decoder (dB) 


Z 6 3 2 i 
TRUE % LTR Error 

SNR (dB) 
moO Hz) 

9 0 ~ 0 - 0 

6 2 IL als _ AL 

3 9 6 | - 5 

Z os 19 - 14 14 


[werd REALISTIC HKM TREE DECODER 

Although the results discussed above are of theoretical 
interest since they demonstrate a high degree of correla- 
tion with theory, they have little practical value in 
determining the performance of the demodulator and decoder 
functions under more realistic signal conditions. The 
first series of tests used a KAM signal as input, in order 
to correspond the results to those above for the idealized 
case and to obtain a basis for comparison with the HKM 
case. Table XIV shows the performance of the tree decoder 
as a function of the decoder constraint length (decode delay) 
mma aS a function of the degree of optimality of the 


estimator. (The degree of optimality is given by the 


oe 





TaD Deen. V 


Performance of First-Order Markov Decoder vs. Decode 
Delay and Degree Of Estimator Optimality — 50 wpm KAM 


Decode Delay (Samples) 


Degree of SNR Avg. No. 
Optimality (OOm Hz ) of Paths 0 40 200 
(P ) aB Saved 2 hrroer % Ecror - ECO 
opt 
eZ 20 
.98 9 20 
20 68 45 45 
i2 17) 0 0 0 
95 9 ey 
18 68 45 a5 
eZ 14 0 
9 9 1s ee 
IBS 56 oy 46 
12 des 3 S Z 
35) 9 12 32 S77 29 
12 58 56 55 
12 8 3 3 2 
8 38 39 36 


68 67 63 


parameter ie discussed above, where only enough paths 


pee 


are saved such that the sum of the computed posterior path 


Peeodbilities > ae ) These results show that the 90% 


pee 


ise al 


optimal estimator with a decode delay of 200 (1 second) 

is very nearly as good the 98% optimal decoder. These 
values were selected, then, for the remaining tests. Table 
XV shows the performance of the tree decoder as a function 
of model complexity, and the improvement in performance 
with increasing complexity at the lower SNR's is evident. 
For comparison the results for the independent letter model 
are plotted in Figure 16 along with the results for the 


idealized case, and the lower bound for envelope detection. 


TABLE XV 


PERFORMANCE OF DECODER vs. MODEL 
COMPLEXITY — 90% OPTIMAL ESTIMATOR, KAM SIGNAL 


DECODER MODEL 


Pirse Second Indep Avg no. 
Speed SNR (dB) Order Order Char of paths 
(wpm) (ROO HZ ) % Error SE ror 2) ape gre ts Saved 
1 0 0 0 14 
50 9 TS 
8 14 11 5 Bs 
y 36 30 16 16 
6 46 41 35 16 
9 0 0 8 
20 6 Ie 3 8 
4 ly 9 
3 43 38 31 9 
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The next series of tests used a simulated hand-keyed 
Signal as input at nominal speeds of 20 and 30 wpm. The 
performance for the good, fair, and poor keying character- 
istics (element error probabilities of .00143, .0149, and 
.0403 respectively) was evaluated for Popt = .9, and decode 
‘delay = 200 as a function of model complexity. These 
results are tabulated in Table XVI. The result for the 
fair sender is shown in Figure 17 along with the corres- 


ponding result for the KAM signal and the theoretical 


lower bound. 


TABLE XVI 


Decoder Performance For Simulated Hand-Keyed Morse 


30 wpm 20 wpm 
Sending SNR (dB) % Letter Avg No of % Letter Avg No of 
Quality CLOG Sz) Eigis@s Paths Saved Error Paths Save: 
9 8 d 9 
Good 6 8 4 ILE 
(Sending 4 36 9 6 10 
Error Rate 3 z 9 31 Tol 
= 13%) 
S 5) 4 126 
Pair 6 10 10 
(Sending 4 42 10 8 alee 
Peeor Rate 
- al 
B03) a ah 34 il 
9 EZ ime ieee Ne 
Poor 6 i3 HAL 153 iz 
(Sending 4 46 eZ 14 jks 
mEbOr Rate 
- 8 14 
= 25%) : =< : 
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The adaptability of the decoder to abrupt changes in 
speed of transmission was next evaluated at several values 
of SNR. This test was run by causing an abrupt speed 
change to occur after every tenth letter. The output was 
then compared to the output for the no speed change case 
to obtain the extra errors introduced by the speed change. 
This increase in error caused by speed change is tabulated 
in Table XVII, as a function of the magnitude of speed 
change and SNR. A KAM signal was used for the 50 wpm speed, 
and a fair sending operator was simulated for the 30 and 


20 wpm signals. 


TAS LE ie 


Decoder Speed Adaptability 


Speed of % Error Increase Over 
SNR Previous Segment Constant Speed 
New Speed 
50 3:0 20 
50 = i 
5) ous: 30 0 = i 
IRD. i _0 - 
50 - 2 
8 dB 30 = 
20 Ih i - 
50 = 5 6 
a aB 30 4 = 
20 4 3 = 
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In order to compare the decoder performance with the 
performance of the MAUDE algorithm and Howe's quasi-Bayes 
decoder [14], the decoder was next tested against simu- 
lated hand-keyed signals using the same mark/space durations 
that were used in Howe's tests. The simulated signals 
consisted of the following keying characteristics: 

Sl - Moderate variance handkeyed: Mark-space sequence 
with nominal 1-3-7 mean element duration ratios and element 
Standard deviation-to-mean ratio of 0.2, nominal sending 
speed of 15 wpm. (Eo, the average sending letter-error 
rate = 10%). 

S2 - Abrupt speed changes, low variance handkeyed: 
Mark-space sequence with nominal 1-3-7 element duration 
ratios and element standard deviation to mean ratios of 
0.15 with abrupt nominal speed changes among 10, 15, 20 
wpm rates. (Eo, each speed segment, = 3%). 

S3 - Gradual speed change, low variance manual: Same 
as S2 above, but with gradual speed changes between 
approximately 10 and 20 wpm over a period of 30 seconds. 

Bach of these files was used to modulate a carrier of 
constant amplitude to which white gaussian noise was added 
Beeesignal—-to-noise ratios of 12 dB, 9 dB, 6 dB referenced 
Memeo HZ. The results of this test are shown in Table 
XVIII. A comparison of these results for the high SNR 
case (the only case considered by Howe) with the performance 
of the quasi-Bayes and MAUDE algorithms is shown in Table 


mix. 
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TABLE AVIITI 


DECODER PERFORMANCE FOR SIMULATED HAND-KEYED 
MORSE USING HOWE'S MARK-SPACE FILES 


File SNR (dB) 
2 9 6 
5) jdperelohe > BEEOr SS EEOr 
Sl 11 11 24 
S2 4 6 11 
S3 5 6 13 
ABLE AEX 


COMPARISON OF TREE DECODER WITH MAUDE AND 
HOWE'S QUASI-BAYES DECODER, HIGH SNR 


File Decoder Algorithm 
Tree MAUDE* Quasi-Bayes* 
Jeong alone 3 Error (Saige 
cub ilsie ZO 8 
SC 4 Ly 5 
S3 5 14 6 


* Data for MAUDE & Quasi-Bayes From [14, p. 74]. 
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C. STATISTICAL SIGNIFICANCE OF EXPERIMENTAL RESULTS 
The sample size used in each of the experiments des- 

cribed was approximately 200 letters. Since the sample 
size 1s greater than 30, and since each experiment was 
performed under well-controlled conditions, the outcome 
of each experiment (proportion of letter errors) may be 
reasonably assumed to be a sample point arising from a 
gausSian density. Under this assumption, the following 


90% confidence intervals [23] are applicable (Table XX). 


TABLE XxX 


90%-CONFIDENCE INTERVAL FOR EXPERIMENTAL RESULTS 


MEASURED EXPERIMENTAL 90% CONFIDENCE 
ERROR RATE INTERVAL 

5% 3%-— 8% 
10% 73-14% 
15% iso 
20% 154-263 
25% PAO eerie BE 
30% 24%-36% 


eke, 





While the relatively small sample size of 200 letters is 
adequate for the well-controlled simulation experiments, 
because of the consistency of the input Signals, a much 
larger sample size would be required for testing against 
actual data. Because of the lengthy processing time 
required on the PDP-10 implementation (one minute of data 
requires approximately 20 minutes of processing time), 
however, it was not feasible to obtain large quantities 
of test data against actual signals. The following field 
results given in Tables XXI and XXII, therefore should be 
Gonsidered a proof of feasibility of the tree-decoder, but 
not necessarily typical of results to be expected under a 


wide range of signal and keying characteristics. 
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eR eu tMINARY RESULTS FROM PIELD DATA 


In order to obtain an estimate of the projected 
performance of the tree decoder under actual signal and 
channel conditions, the algorithm was tested against several 
tape recordings of signals made in the field. Analog tape 
recordings of the output of a receiver using a 4 kHz IF 
band width with fast-attack, moderate-speed decay (approx. 
200 msec) AGC were made. These tapes were digitized using 
a sample rate of 8 kHz. Each cut is approximately 50 
seconds in duration, resulting ina relatively small, but 
Significant, data base for analysis. The text in each case 
was context-free, and all signals were of sufficiently high 
signal-to-noise ratio so that the true transmitted text 
could be recovered from the detected output. The results 
of these tests are shown in Tables XXI_ and XXII 


for the KAM and HKM signals respectively. 


TABLE XXI 


PERFORMANCE OF TREE DECODER AGAINST 
ACTUAL SIGNALS, KAM SENDER 


Sample Data Rate Avg SNR (dB) Letter Error 
(wpm) (EO SEZ) (3) 
i 355) 20 13 
2 30 16 2% 
3 Z48 ie 13 
4 32 18 103 
5 30 20 8% 
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TABLE XXII 


PERFORMANCE OF TREE DECODER AGAINST 
ACTUAL SIGNALS, HKM SENDER 


Sample Data Rate Avg SNR (dB) LettereError 
(wpm) (100 Hz) (3) 
Ih 18 20 4 
2 Lig 16 3 
5 Ze Te: Lys 
4 20 20 8 


The disappointing results for samples 4 and 5 of the 
KAM signals are attributed to two effects observed on these 
cuts. Sample 4 contains several long sequences of high- 
level "static" or "burst" noise, which appear in the 
envelope-detected output as energy which is inseparable 
from true marks of the desired signal. Although these 
false marks are of lower level than the actual signal, 
the algorithm assumes that they are faded marks of the 
incoming signal and demodulates them as such. Although 
the algorithm successfully rejects many of the shorter 
spurious marks because they are inconsistent with the 
speed of transmission, enough are accepted as valid marks 
to cause the error rate to be high. 

In the case of sample 5, all of the errors are attributed 
to a low level Morse interferer which becomes predominant 


when the desired signal is in a word space or pause condition. 
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During these times, the receiver gain is not controlled 

by the relatively high-level desired signal, and the under- 
lying interferer is of sufficient SNR (approx. 8 dB) to 

be demodulated by the tree decoder algorithm. 

For the HKM cuts, the comparatively high error rates 
for samples 3 and 4 are attributed to the same type of 
interference/AGC effect discussed above, although in sample 
3 the interferer is one leg of an FSK teletype signal. For 


all the HKM cuts, the sending quality is rated as good-to-fair. 
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AT. SUMMARY AND CONCLUSIONS 


The extinction of communication by Morse telegraphy 
has been repeatedly predicted aperiodically since about 
1950. While the commercial use of this mode of communica- 
tions 1S virtually nonexistent in the U.S., except for some 
Maritime services, it is still used in the military services 
of many countries. The reliability of Morse links is 
well-known and long-distance communication, particularly at 
HF, 1S possible under conditions of interference and atmos- 
pherics which would render other means of communication 
useless. The simplicity, reliability, and efficiency of 
the receiver (the human mind) preclude extinction of this 
oldest form of successful electrical communications. 

Radio communication between two persons using Morse 
code is a distinctly human process, involving nuances of 
code variations and tacitly assumed conventions between 
the communicators, which make machine transcription of 
the human-sent code particularly difficult. The theoretical 
development of a unified structure for modeling a Morse 
message (not just the code itself) presented in this report 
Shows how the various aspects of linguistic context, 
e@emacting, individualistic operator sending peculiarities, 
and code symbol dependencies may be combined in the design 
of an optimal Morse translator. As a practical example of 


modeling of the Morse message within this structure, a 
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model for independent equally-likely letter messages was 
derived, and the resulting decoder was tested against a 
variety of simulated and actual Morse messages. 

The results of the simulations show that the error 
rate of the idealized KAM decoder [Fig. 14,15] approaches 
the theoretical lower bound for the gaussian channel, 
derived from coding theory arguments, and that the increase 
in performance compared to a linear dot-matched filter can 
be significant at low signal-to-noise ratios. Secondly, 
the performance of the HKM decoder using envelope detection 
[Fig. 16] was demonstrated to be only moderately sensitive 
to the non-gaussian nature of the noise statistics at the 
output of the envelope detector, for SNR's above approxi- 
mately 4 dB in 100 Hz. Finally the performance of the HKM 
tree decoder against simulated hand-keyed Morse [Fig. 17] 
shows that, under these laboratory conditions, the tree 
decoder can be expected to provide an error rate no worse 
than that of a human transcriber for: (1) output copy with 
an acceptable error of 10% or less; (2) independent equally- 
likely letter messages. In comparison with the MAUDE 
algorithm, [Table xIx] the tree decoder shows a significant 
decrease in error rate on the simulated data, while in 
comparison with Howe's Quasi-Bayes decoder the error rates 
are about the same. 

These results show that for the case of random letter 
text, the performance of a human operator can be very nearly 


obtained by optimal non-linear processing techniques. The 
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estimation algorithm derived in this investigation is 
adaptive to speed changes, varying noise levels and fading 
Signals and has performed for approximately 90 hours of 
running time (approximately 21,000 characters total) without 
exhibiting any noticable signs of divergence or instability. 
The computational burden is severe, however, and for prac- 
tical use would require possibly a pipe-lined approach 
with digital hardware under microprocessor control. 

The strength of the tree decoder for random letters 
lies primarily in its use of the Morse code structure to 
perform channel decoding, i.e., demodulation, and secon- 
darily in its use of the structure to accomplish source 
decoding. For contextual messages, however, a well- 
constructed model of the linguistics, semantics, ad format 
embodied in the structure of an appropriate f. text  LunceEven, 
describing the evolution of the message states as a finite 
state machine, would add significantly to the error-correction 
capability of the decoder. To the extent that such a function 
Can accurately describe the Morse message linguistically, 
the error-rate for contextual messages may be made to 
approach that for the human operator. As such, the parallel 
between the problems of Morse translation and automatic 
speech understanding is evident and therein lies the rub, 


and perhaps, the solution. 
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APPENDIX 


SAMPLES OF OUTPUT DATA 


In order to obtain an intuitive appeal for the errors 
produced by the tree decoder, several examples of 
output copy are shown below for various levels of 
keying quality and signal-to-noise ratios. Errors 
are indicated by an underline. 


Pee wom, KAM, 12 dB SNR: 


A LAZY BROWN DOG JUMPED OVER 2 LOGS 


ON A SUNNY SUNDAY AFTERNOON 
tee 20 Wom, Fair Key, 9 dB SNR: 


A LAZY BROWN DOG JU.ED OVF 2 LOGS 


ON I SUNNY SUNDAY AMTERNOON 
C. 20 wpm, Fair Key, 6 dB SNR: 


A LS7 BORWN DOZ JUMPED JHF 2 LeGs 


ON A SUNNY SUDDAS AFDRNOON 


D. 20 wpm, Fair Key, 6 dB SNR (same as C., but with 


a different noise sequence)  : 


A LSZY BROWN DOZ JUMPED OVEL 2 LOGS 


ON A SUNNY IUTSANO AFTEGNOON 
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20 wpm, Fair Key, 4 dB SNR 


V LAZX HROWN DUD JUMPED JVEL IMI 


L_OGS ON A SUNNY IM6ACN AFORNOON 


15 wpm, KAM, 12 dB SNR 


CWA6 DE LAB IAW THE QUICK GREY FOX 

JUMPED OVER THE LAZY BROWN DOG ON A 
SUNNY SUMMER AFTERNOON. THIS IS A 

Wools SvvveavAL JGBA CBEY IONH 


OE NE were sURhUC RHIC MUSX SKYO 


15 wpm, Fair Key, 12 dB SNR 

CWA6 DE HHH IAW THE QUICK GREY FOX 
JUMPL OVER THE LAZY BROWN NROGON 
ASUNNY SUMMER AFPTERNGON. 6Is IS A 
NSCK VVV JVXI JGBA GBEY IHIH 


CURE ecrlruU UKUC RMIC MUJIX SKYO 


15 wpm, Fair Key, 6 dB SNR 


$A6 DE 5HH IAW 5E QUICO GREY FOX 
JUMPED OHER T5 LAZY B50W5 NROG QN 
ASUNNY SUMMER AFTERNOON 65IS A 

NSCK VVV JVXI JGBA GBE3SHIH OPRAS 


Sire U Shue Rote MUIX SKYO 
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The waveforms shown in the following Figures (Fig. 

18) are provided to give a visual appeal to the quality 
of the signals processed by the tree decoder. In 

each figure the input Morse keying signal is on line 

a. Immediately underneath, on line b is the output of 
the envelope detector after the carrier has been 
modulated by the keying signal, additive noise applied, 
filtered and finally detected. On line c is the 
detected signal, after downsampling to 200 Hz and 
adjusted in level by subroutine NOISE. The output of 
the zero-delay MAP estimate of the keystate (the 
demodulated signal) is on line d. These waveforms are 
the result of processing message E. above. Note that 
although the demodulated output in many cases is not 
correct, the correct letter is still decoded, because 


of the soft decisions utilized in the tree-decoder. 
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COMPUTER PROGRAMS 


INTEGER EL MctAT, XHat 


Oreo tUN st(3l2),S2(512),83(512) 


DIMENSTON S4(512) 


eae A 
OATA 


Gale ty 
CALL 
9) 2 
O09 3 
GAUL 


CALL 
GA 


Risa 17 
NP /Q/ 


Litt L 
TAPU TIL 


wlsi,S5i2 
Nest,13 
SIMSG1CX,ZS8IG) 


RCVRCZSTG,ZRCV) 
SPFNETCZRCV,ZIET) 


NPSnP+! 
LE Cee oet.42) GO Tl 3 


NPs 
eve 
GA: 


Newse (ZPET, KK", 2) 


PROCES (2,RN,XHAT,PX,ELMBRAT,LTRHAT) 


CONPINGE 


Nan} 
Gage 


STATSCZDET,Z «PX ,XHAT,S4,32,83-84,N) 


CONTINJE 


Call 


BY TG 


STaP 
Ent 


PiSorEACelecers 3704) 


! 


tS, 





90189 
92230 
09344 
O94dd 
205A 
04699 
Ag79a 
agana 
90909 
apaan 
01122 
Alea 
(9134049 
(914ae 
015399 
81604 
QL79a 
At33% 
e19ud 
92943 
O213% 
M22 dd 
92332 
R24U4 
8253023 
02694 
O27 aA 
Q2824 
M2937 
Q38QA 
NBL DA 
O32 3A 
0$3aV¥ 
Asada 
M3508 
(93499 
ABT ay 
Q38a9 
93940 
B4A39 
BNL 2A 
AQQAA 
943.39 
Paani 
8453) 
Q44an 
84799 
44842 
249.34 
Baga 
Mae 
AS52945 
953ya 
ae 
AS5.3:0 
36487 
Live, 
(0548.0 
A590 
ARAN 
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SUBROUTINE INPUTL 
DIMENSTON ESFP(6),FDEYV (6) 
COMMON /OLKI/TAU/BL<6/0MEAN, XOUR, EF SEP, EDEV 
COMMON /BLRA/WC, wCHIRE, ASTGMA, SIGMA, PHISGM, 
ERSIGM, TERIBP, GAMMA 
QaTaA eee te 57, ESEP/1,5,1,3,7, 147, 6DEV 65007 
DATA XDUR YUL S 


TYPE jaa 

PORMATCIX,*° INPUT KEYING PARMS: RATE,MEAN ELEM DURATIONS®) 
ACCEPT 2A4,RATE, (ESEP(K},K21,6) 

TYPE 15929 

FORMATCIX, INPUT ELEM DURATION STD DEVIaTIONS?’) 

Meee 277, (EDEV(K),K2], 6) 

FORMAT CTF} 

TYPE 344 

FORMATCIX,*°]NPUT STG PARMS= AVAR,BVAR,FCHIRP, TCHIRP,PHIVAR®) 
ACCEPT 249, AVAR, AVAR,FCHIRE, TCHIOP, PHIVAR 

TYPE aan 

FORMATCLX, “INPUT STS PARMS: GAMMA,FREQ,NGISE®) 

ACCEPT 2930,GAMMA,FC,RNOISE 


ASTGMASSARTCAVAR) 
SSTGMassirRT(avar) 
PHISGMsSSIRT (Pal Vabr) 
SS PG V=sSUR I (8HOTSe) 


CHEANS1L 299 /RATE 
NEW LPP SH, ARASL Ye FP CHIRO 


Mae oer (i dar.) GO TO Sue 
Moe jus to, 

SEP (2) 2%, 

oer (5) 21. 

Pore id) 25, 

Soe PCS eT . 

eyee (rsd. 


rETUR y 
er. 4 


Soe viene Tt Ti. 

JIMENS TON LELAST(4909),TLAM{ (16), IL AMY (A) 

WE StU SeLEMTR( 16,4), 2 TRAM SES, 2), 15x (5) 
NINENSTOM “MEMFEY(490,6) ,LTRHAP (499), TALPH(740) 
eee eM Del (6551 MEPS Gee or LAGE (499 ) 
WEE wots LANRAY (CA), TTEXT (200) 


COMMMAW/BLALAM/IEL“ST,ILA“L, ILA“X 
SOMA / SLA UAT /YMEMOEL 
COMNON/ALKELM/ELETA/ GI XSPO/RTRANS »>MEMPR 
COMINM/BL K4EM/NEMFOCN/BLKS/ISY 

CIK AC N/ SL ATEN /LITRMAP, TALPH, IBILANK 
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96124 
aged 
16390 
1h4AG 
06590) 
96604 
ag794 
2632 
96990 
(91u29 
A710 
a72ua 
A732 
Alig 
919399 
07630) 
(477959 
9790 
MBA QA 
819A 
(982230 
PASYY 
184130 
28549 
18594 
698740 
98820 
NAVI 
AIA YA 
19109 
49249 
69939? 
94a 
09892 
196n7 
ADT iA 
09809 
A99YA 
{dda 
{elo 
dean) 
13329 
—61N4aae 
(10520 
— {Ganaa 
ld? 
yeaa 
18909 
, 1499 
—thtyaa 
thers 
tysy 3 
L{4aua 
1ySe0 
Lyaar 
W722 
1y8ue 
jana 
leanne 


34 


ie 


Ic? 


VU Re TU TG 1 Tu 


Tw 


fw Mw AW MH Mm AZM TT TM 


N 


COMMONS BLK TXT/SITEXT 


NATA T54/1,1,0,0,29,9/ 

DATA MEMFCN/9,11,13,1559)11,13,15,9,Ge110004309015 
Sb4xai, 

Lids ase Po514512,14991657,19,0,12,7,14,0,16, §38aen, 
es eae ae Bees Oa ly os L- oye Pere eye: ve 

0,2,%, BPMs Bea, D2 45,245,25%,2,6, 38080, 

143,3,9, a ple og) y Sp le sats Sat panne, 
eg no ee, 


Pe sl Ge, 5,4,5,677,8,97 1dr lis ber 
13,14,15,15,384x%0/ 

ieee TEAM / 54, 3765594) 576, Leer lvey leer ls e/ 
CaTA ILatk/1,1,4,9, Dy a7 


MATA LTRMAP/3,4,5,6,3,4,5, 6,1, 2,1, 2rt ey tye, SB4RO/ 
chat 4 Peeeantifcnnie re tse 8 COs i yiel ee SP ee aed Cpe) en eae 
POOR Le ee, ON Oe Ope ene eRe ese ope ete, 
Bee eee a Ge og kg Pg ee pe So gees aie ee oe caries 
G0 tl Cae area ie uOG Cane yc ein acl f 
brite | hh 6) ces gee AE etre Garg t, o haalalle yr 
IMTS, 2,%,%) 0, 987", 2,8,8, ERE S/ 

a alae ep cixo) 


WeWeg eee. 554.5 Sa 6 Dee 8 Does OF ot OPO Oa 
Ss Dek Sy be Pe pa Dre DP OAM es 

Die ela S tgs 9255 ICN as PO Sue te ne Cea 8 es 
Be. go 5555 0 55 M2, ONC, FO2,,0620,.94,,24, 
OI? cig (1S) pete. VLc ped Lepr p tiem ete. 257. 007, 
A ie <* gee ye OMS 5 oO Ope ION gs om oe 6 Oe? 


DATA Rea ol /guitip ue poaldspia- Cv tecl-pna) pele goo pawle atl 7 
ee es et era ply Ey lar are Sy) Ul 

ene. EE ON ites oe) aor eal OMe Carmenere rar alre Stic yp 

2,2, Ge, ‘A,A/ ° 
ae MENS, Vel 
pg a 4 te lo 


eDrFalee@eletelol ssrB, 4,0, 
Cei,t a a, 2,Aa/ 


OPEN CUNT Tse4,FlLes’MORSE™M? ) 
MP 4% [21,426 

READ (AR, 30) CIARPAY(K),“21,8) 
FurRMAT (CATS) 

OO 11 &241,4 

MEME CNCT, KJ) SIAR RAY (X42) 
LTRMAP (IT) sTarRay(1) 
VoeaSt ct) slARRAY! 2) 
TE CC WEL MST CI) ED. 7) 
IRLANK (I) #1 
oe wor tl) .FG.a). 
oe) = 

CO eer 


OS SCE eis Tt Cha 1) 


OR 2 Chemist |i cea gaeu 


re Gy | A aan a 
UPEM CUNT Ts8d,FILE= 
os? leal),.3e 4 
Pett Cau  ) 


oct 1 Or BB, 
(MEM CAG] ee) « * 1.56) 


on 


(De 





4A moor Mamet (YX 76 (1S, 2%) } 


50 CONTINUE 
ENDFILE e5 


UPEN(CUNTT=s24,FILEs*TEXT*) 
DO 64 Tai, 2.95 
Reema, 74) LTEXT(1) 


Eo FORMAT (T2) 
6A CONTINUE 
Sor ile 24 
RETURN 
END 
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Wie 


ier 
i233? 
ig4y 
598 
Qhay 
Q71a¢ 
28a 
2948 
1225 
142% 
422 
3% 
{4.2 
1904 
$607 


1799 


1300 
1944 
eae 
elua 
220. 
230% 
2e24aa 
e5n2 
2668 
ergy 
eBan 
29a 
(3367 
‘$i1ua 


13ean 


3302 
34g 
13532 
‘SAG? 
S732 
Sana 


13944 


APRA 
12a 
42n2 
4 aud 
Aad 
Ida 
id 
FW Made, 
IQay a 
Q9aa 


Sava 


Sian 
S2aa 
'S3aa 
15479 
ISSy A 
‘Sh7a 
| oh 
‘SRA 
S942 
baa 
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DATA AMP/1./,5FADE/U,/ 


wh TUR Ps NG TU fe 


SUBROUTINE SIMSG61(%,S1G) 


COMMON/SLAKI/TAU 
COMMON/SBLKA/ NC, wKCHIRP, ASIGMA,BSIGMA,PHISGM, 
Moti, |OUR LRP, GAMMA 

Pie BOLAST/1,/,S8GTA/1,/ 

UME TAZ. 7, PHILS. 7 


DURSBETA 

CAEL eae ee 
BRTASBRETAR(C) = Lo¥LAST +2, 
Ta OM ee ast 

Kner oues X 


eXeXL ASTI +1, 


Ate RAN DN G4, 1,24 ,AS 1G 4A) 
AMP SAMP+TK ev 
WeGae ot jae |). AMPs. 073 
Gatomeraghi(“, 1,7 
BFADE SGA 


poo lan A) 
AABRFADE ow 


AMPopsaAMPeBF ACE 

Pe UAC eee ieee YOl) SBFADE SA ,Aa21]—AMP 
AUP OX SAMP HBP AE 
TONURZSIGAD © TAUwKhETA 

WOHKP SX eWwCHISPREXP CoTDUR/TCRIRP) 
THE TASTHETAS CvCenCHRP ) a TA 
THETASAMNOO CTHCTA,6,293319) 


PAL Sees ren FT OGH) 
PHI SPHIT+TK ew 
Pa = sr OO CPT so. 28519) 


SLG2X%eaNPBxStn (THE TArPHT]) 


CALL RANON(CZ%,1,0,.,R9T6") 
SIGsSrGr2N 


RPETUR A 
FAN 


SHBRQUTTRE KEY (DUR, X) 

DIMENSION FESEP (6) ,EDEV (6) ,MCRSE C10, 44) 

Meee ToT (S77), (SYMAL (6), TTEXT (eae) 

Cove N/a Rem, TEN 

Cie CNSR YL /TAUSRL ES /OMEAN, xOUr, 

Cone Gat 41/7 1 Pe wT 

MATA TAS "SAL AnaAangaga,/ 

Ores Pee A/a NAY NLTR IS / 

Autos BLOG. Se 72 a i i ees ae A,2,8,0,3.9, 

Cee ep pe 4 ly bp hp Sa le 3a 1 oe A,A, 

aft pO ig er ne , aA ms 

Jee Se ae ee out pg 5 aa. 

a Ga ’ an 55 ne sae ee 

ee doae Bes Rime: PAOD? 

NS gyn in Shy AR A irae 
3 
‘ 


Porro ev 


BeBe be De Ts DN! 
“\ 


aay holt ir sie 








no1ar 
16244 
16328 
Phau 
06529 
BHAA? 
20704 
96842 
96929 
97200 
a7104 
27202 
730A 
A7BQH 
AT 5a? 
@76¢9 
97729 
Afaar 
17922 
PAROA 
dale 
ABSAA 
88342 
BBGAA 
285230 
8622 
8722 
26820 
9893 
AIDYA 
ALAA 
agena 
O93a4 
AGA YA 
C95u2 
BORA 
19755 
N9AQ 
89992 
Lga2n 
1gi32 
le 3A 
1a3ga 
{aaa 
1a53A 
16270 
‘18749 
SULZA 
129.20 
Lage 
Vigo 
{122 
TS 3A 
Lana 
S47 
Llear 
Lr ga 
Lava 
11929 
Leann 

















ine 


NM Ww 7 % fw Mt PTR 


eens) 17 2974, 0,9%,1;,3,1,3.1,9.0.39.0.8 
242) 2,9,9,2,9,6,9,1,3,1,3,2,0,9.0.0.9, 
be syd 34t,542,%,9,0,1,3,2,3,2,9,9,9,0,%, 
© 3414351,3,2,9,9,9,2,3,1,3,2,3,2,9,0,2, 
C4 542,3,1,5,1,5,8,9,1,3,2,3,2,3,2, 3,2), 
Pre ae, 3,25, 13,1, 5,145,273) ones 
Wet sn ln 3.173,2,%,41,553,3,1.5,1,2,1,0, 
Coded 3h 3514 30144, 2,3,2,3,4, 391, 30158, 
Be Selves tS 0,2, 5,2) 3,2) 3, 2530 as 
Poe, ses Sse, pe, 0, 4ORa/ 

DATA ISY@BL/tHay LH, TH V1H/,9N9, SRN 


RETASIOASA eke TAURDUR 
Meeherea CT. AGUR) GO Teo aan 
NELMESNELM+ | 

Tel MeMORSECKELM,LTR) 
Phere etibew) GO TO 109 

ie MS} 

YaraN(Ta) 

ae Msg 

1 lee cer Seliace 2) ig leinkese 

ee ewe ea DO Cr eG ie 4) ) Pele 
Peg aOie fo, 

SG eee Ue ro 

Tysy 

Piao y+4 


Gea 10) 439 

NU TRENL TF +] 
LTRSTTEXT (NUTR) 
Pein se. 0) TEL“s4 
TF OLTN.EN,37) ITELMsS 
Wet R en 33) = Let 1S6 


ae haat 
memo ere XT (NE Te ) 


NSN] 
TOurTCw) sl SYMAe CIEL) 
Wee ites jo) FO f 1G 
“Vs 

Mets 

Lam = | 

TYPE Ga 
eat 7 4/7, | Y , 
OU 12 “s pi4 
AL2(Ket) «Sne] 
ARK RSA 

ee meee CL CUT(L), L214 2) 
a 

CONTINUE 
ACCEPT Fr 


*> ENT OF RUNS 


YA,4ATT 


P searPlreL: ae | ROMEAN 
SFOEVCTEILM) e«GMEAN 


or .¢£ 


ee oe ei 


ae ee SD 
ea ee eX S15. 


Ceti les, ) SUR See. 


aa TU) fe 8 


cr aS coon ED oS, ne Se = 


—1 2° 
m 


we eget) A=, 


Be 
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PA hie Elke WAS S$? 


r/) 





23a RETURN 
END 
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a0122 
ageyu 
90340 
a244ea 
ag5an 
02644 
407290 
eaeye 
gg922 
ayer 
91199 
Aayean 
913A 
41409 
0,322 
O16YA 
O17 230 
#1894 
—«ALIOA 
R200 
g2iae 
Q2234 
92399 
Aedad 
02523 
26.9% 
02729 
2890 
—6 829A 
| 938Q7 
ag1an 
a3242 
83302 
34.34 
6 835949 
683649 
93792 
43633 
a59QA 
a4AAA 
64h 4G 
Rae gA 
A439.4 
2449 
A458 
GAG: 
BUT 
4A} 
NAQAA 
AAG 
031229 
(8923 
25340 
aS a4 
A853 
49643 





LAGA 


129 


> 


Seem aytlTweE DISPLA(S1,S2,93,54) 
OIMENSTON $1(512),82(512),83(512),84(512) 


CALL 

mk \ 

GALL 

GAL 

C aye 

Galley IEA (®)*) 
ACCEPT 1249,waAlIT 

FURMAT (aS) 

RETURN 

ENN 


ERASE 


Supe cer ite STATS (XTX INS, Ys Md, St, 


Gea pusgo +, ) 
DI MENS TQ 


SiGe) sxInt 
Séeiv) sxIne 
SV AION ee Gakic’ 
Sa (i) =X jee 


RETURN 
ENA 


SUBROUTINE AUTOCR(385,RS) 


SLUENSE 0 


Wath o7 Lee fy XN SO / 


XNSKN Ge] 

Cu tauvd Is!l,5v¥ 
Miya oC 1) 

Po (1) =f. 

CCT ENUE 


DU e220 J21, Se! 
G0 324 421,592 


MorGl ers) (1) +5 (Kt 1 =1 xO Cr) 


Cen) etre 
Cost Gio 


HO 4¢A 121,506 


oelusmecs (1) 9 (X= le) tho Cl) aN 


CUNTIAUE 


RE TRA 
ENO 
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PLOTR(S1,512,9,%M, 494) 
Bw is(se,5le,% 5X4 pe? 5) 
Peek C55, S51e,1s le, 150) 
PILOTRK(S4,512,2,%4,4@) 


Peo lel se (aA chp oe Oo he) 


$5(512),83(9812),3861008),R5S1 (544) 





= 


ee ie 





019 
692 
49052 


19402 
(00549 
10650 
“go7ae 
(99892 
009428 
ALAY? 
a1149 
ai2an 


g1394 
“944u2 
g1saet 


(929.4% 
(421 ae 


M2242 
ge3e0 


2400 
92503 


12643 


eT ee 


02935 


69290 


a5A ju 


astaa 
aea9 
93399 
934923 
13529 


03543 
a3TAA 


6038.42 


9390 


| AAAs 


04149 
84249 
Asada 
O48 42 
M522 
B4orAr 
NAT 39 
CORBA 
04934 
Q39BA 
M31an 


05292 


5329 
A54An 
95529 


BS bea 


. 


| BA 
BSAA 
AS W0e 
Ao 342 





SUBROUTINE PRUCES(Z,RN,XAAT,PX,ELMHAT,LITRHAT) 
Ae AKA KARHKKRARARKARARKWKAKRKRARRERADRERKRANRKAREKERREEREKRRARE 


THIS SUBROUTINE [IMPLEMENTS THE PROCESSING ALGORITHM 
FOR JOINT NEMOOULATION, DECODING, AND TRANSLATION OF 

THE RECETVEN MORSE PROCESS, IT TAKES IN A NEW MEASURES 
MENT,Z,0F Trh€ METECTED SIGNAL EVERY 5 MSEC AND PRO@ 
WUCES AN ESTIMATE OF THE CURPENT KFEYSTATE,ELEMENT 
STATE,ANO LETTER OF THE RECEIVER SIGNAL, 


QEFINITIGNS OF VARTASLE NAMES? 
Ze INPUT SAMPLE OF NETECTED SIGNAL 


R\e INPUT NCTSE POWER ESTIMATE 

X4AT« OUTPUT ESTIMATE OF KEYSTATE 
FLMMAT = Hote o| ESTIMA tre Ch ELEMENT STATE 
LTRidqafte Diet y ESTA Te Tf Lemme SPATE 
ToAayee NVQ, OF PREVJOUS PaTHS SAVES 
IPATHe TRENTITY OF SAVED PATH 


LAMAOACT |eTMEATITY OF LTR STATE NF SAVED PATH I 

Duna (I)@ NURATICON OF FLEMENT ON PATH I 
TLPATECIT)I@ISENTITY OF ATA RATE AN PATH I 

PIN(L,N)»= COMPUTED TRANS P9208 FROM PATH JI TO STATE N 
LAMSAV(J) @=IDENTITY OF LTR STATE AT MEW NODE J 
Peay Cle Gj eENTETY OF DATA VRATE AT NEW NODE -J 


LkxnoCJ)= LIKELIHOOON VALUE FOR NONE J 
PCo = COMPUTEG POSTEPITO® PROA OF PATH 
EMOING AT NEW NGOE J 


PSELEN(X)=COMPUTED POSTERTOR 9ROB OF ELEM XK 
SPOHAT CON) MEAN ESTIMATE OF INSTANT MATA RATE 
Pye POSTERIOR PROB THAT KEYSTATE ESUALS 1 


FOLLOWING SUBROUTINES ARE UTILIZED: 


TRPROBe COMPUTES TSANSITIGN PROBABILITIES 

PaTii= COMPUTES INENTITY OF NEw PATHS 

UGkpoe COMPUTES THE LIKELIROUNO OF EACH PATH EXTENSION 
Pa NR P= CO4FUTES POSTERIOR PROAS OF EACH NEw PATH 
SPRJ8=s CUMPUTFS POSTERIOR PROAS QF EACH STATE 

SAVE oe SAVES THE HIGREST PROG PATHS 

PReEi_TSe FURMS 4 TSELIS GF SAVED PATHS 

loeoie= FRANSL ATES Toe LETTES SSTIMATE 


Peaster CONSTANTS ARE SjOmev IN COMMGEN, 


Trey 90) €9 479 09 05 09 CY FP OY OO OO Se TIT) OF 8 TO a ee Or eI saa see oe) ae eS Ge os 


RMR RRR ERE KKK MK RRR KRAEMER RK RARM RRM KHERKEKAREKAKRAAN 


ee Al LKat 

INTEGER ELMHAT,XHAT,PATHSV, SORT 

yPoteotee. AMR a C25) pOUR C25) 5 Pee tte (e5),PIN C25, 32) 
OIMENSTON LAMSAV( 752),0URSAV( 750),TLRSAV( 750A) 
RIMENSIGN Lako(752),F (752) ,PSELEY(4) 

JIMENSTIM PaTeSv¥ (25) ,SORT(25) 


DATA 
Van 
mah ier' 
ny ean 


Peale’ 


ISAVE/2S/ 

LAMBDA AS®S/ 

LLPATEsS aly, dee, 52387, 5849, 54507 
ep ee hg 


Pes AV JT SOR S/ POUR /e5e Ie 4A / 


Lod 





g6igoe 
Abeda 
06320 
16492 
aasaa 
M6604 
p67 24 
kek Mal 
26920 
QPagu 
A710 
g7ean 
A732 
Q7aaa 
07529 
aATHGa 
OTT 
27884 
ATI A 
aBYU A 
aaiga 
N82a2 
Oa3e4 
gadar 
MAGA 
18639 
RATA 
06809 
19G2 
SEs 
9184 
| AGAAD 
99342 
09422 
AGRA 
| 29602 
5785 
297524 
AGB 
(AGORA 
—(1ebe 
Miu 
devo 
(14392 
BUC aE, 
‘19504 
ldo 
A¢7?aa 
L29an 
lage 
, a 
{yea 
W3a0 
Be, 
M57 





| oe 


1}73@ 
Hav. 
119y2 


CV Cry Cie) <4 


144 


CVs Coa Oy 


a eae J Se a a 


13a 


tia 
1 


mm OM 


ary 


QATA TLRSAV/7TSAR2AO/,PATHSV/25%S/ 


FOR EACH SAVED PATH, COMPUTES 
TRANSITION PRORABILITY TO NEW STATE (TRPRUB)? 
IGCENTITY OF EaCH NEW PATH EXTENDED (PATH); 
LIKELIHOOD OF EACR STATE EXTENSION (LIKHN)3 


NO 17a Tei1,1Save 
Peat he ft 


SoG Ter eOat PAS PEAMODA (TSR CT) pILRATE CL) GP UN) 
CALL PATHCIPATH,LAMBNACT), DURCI), ILRATEC(I),LAMSAV,NOURSAYV, IL Ri 
See Linnie e RY, IP ATH, LAME DA LLY, ous C1), 

Cee OE PP EN, LRH) 


Cant face 


RAVING QOATAINED ALL NEW PATHS, COMPUTES 
POSTERIOR PROBABILITY OF EACH NEW PATH (PROBP)3 
VESTER Gate PRORAGILITY OF KEYSATE, ELEM STATE, 
COMOITIONAL 4EAN ESTIMATE OF SPEED (SPRNB); 


Gi PROSP (PL PIN, LSAVE, LRRD) 
CalLtL SPROB(P, ISAVE, ILRSAV,PELM,KHAT, 
2 SrPCHAT, PX) 


XY hats 
Perr x Sle.) KEATS 
SAVE THE PATHS WITH HIGHEST PROSABILITY, AND 


Eek tae VALUES CORRESPONDING TG THESE PATHS S$ 
CALL SAVEP(P,PATASY, TSAVE, IMAX,LAMSAV,NDURSAV, 
Peeve eee DA, OUR, ILRATE, SORT) 
eon at 
TYPE j{daar,Z 
fy moat ts 7, tX,F Lael s 7) 
Mt TNecilgiaave 
TyPe 1127, IM,PCIN),PATHSV(CIN) ,LAMBDACIN) ,OURCIN), TLRATECIN) 
Clearer UR 1 (1S) ) 
A Pgetnt (ik, 1S,2%sF 18.7, 2% Mex 1S, ek F Oni, 
cer Nts 


2X%,15,2%,F19.7) 


Tea Tee el LS 
Sigtetn LETTER STATE 


wT TH Bein SAVED 
Sone Aeces 


ONES, AND 


Spe eels (ISAVE,PARHSV, LAMBDA, [mA 


rE Tye, 
Fe h, (* 


G'S 





| 27209 
21e” 
gaya 
ese 
2499 
esZ” 
2b 20 
eta 
2898 
—62922 
Pas 
31a 
$202 
3340? 
34904 
3538 
3H227 
3726 
38a¢ 
(3902 
GAan 
41 gr 
ge? 
asuv 
(HAAG 
454° 
(460? 
470) 





4Baia 


GFAD 
504) 
Siv? 
ee 
693¢4 
$440 
5524 
(SAH 
“$720 
5849 
P5°u0 
339 
o1lua 
—6bee 
634% 
4g 
adzZa 
DAV 
66749 
ody 
(99¢4 
f943¢ 
713% 
7240 
7359 
74320 
me! 
THAD 
PP.AG 
Tarn 
Gar 





SYRROUTINE TRPROBCIF,LAMBDA,NUR, ILRATE,P) 


Per ercerceeeececeeceececeercrecrrcrcerrrrcrcerrrcerrrresereoerrreceeeEEroEEELeries. 


CV CV CVI Or OA a er Or oe ea 0 


mon 


i) <> 


a7 


is ee ea 


Luu 


folsesesCTINe COMPUTES THE TEANSTTION PROBASILITY 


FROM SAVEQH PATY TP TO EACH STATE “i AND STORES TRE 
aoe tet Pilr yy, 
VARTASBLESS 

IPe THPUT SAVED PaTR IDENTITY 

LAMBD ae TNPUT SAVED LT® STATE IDENTITY 

NUP @ TNPUT SaVEND ELEMENT NuRATION 

ILPATE* INPUT SAVED DATA RATE TOENTITY 

P= OUTPUT TRANSITION PROAABILITY MATRIX 


THE FOLLOQAING FUNCTION SUBRNUTINES ARE USED? 
XYTRANS@= PETURNS TRE KEYSTATE TRANSTTION PROBABILITY 
COUNHDITIONES ON ELEMENT TYPE A4iN OATA RATE 


RETURNS ThE PATReCONDITIONAL STATE TRANSTTIGON PROB 


RMR RAR RRR RK WR RRM RRR KK RRR ERK REM R RK ARTA EAR AREER 


Pi ese ea Ces, 54), he LNSt (4m), 1LA41 (15), 1TCAMx C6) 
OlM“exwnsStToM PIN( 39) 


CeO KAM, TELMST, ILAMd, TL AMY 


Sole eee er eNt Tyee FOR LIK STATE LAMBDA: 


JF CLAMADA,1E.9) GL 
Roe WwaeNa\ , 5 
P(IP,N) sa, 
CONTLNUE 

ee a eee oe, 


TQ eg 


Po Gevansmer iC TEST CL AGA) ) 


Co Ot eeeeorn te FRAVOTTION PROBAGDILITY: 


PTPKXSXTRANS(CIECLEM,. OUR, [LPaTE) 


je SEM eho PATE, SrAte TRANS Tt pom PROBABILIEY $ 
gre dea ite 
OY jp4w KEL,o 

Pe a ea ee 

Ne(Lefixher 

KE LMeK 

TeaTes! 

CALL PTRANS(*¥ELM, [RaTE,_LAMPDNA, TLRATE, FTRX,PSUM,PIN,N) 
Cia oe 


eae ally Ss 


PCIP, 4) SPIN (CN) /PSUM 
169 





{8900 323 CONTINUE 


{81aa 

{aeva ans RETURN 

18340 ENA) 

{gaar 

18533 

{a6u2 PUNCTION XTRANSCIELEM,O2, JRATE) 

{8743 

{6892 Coe IR ROK RK ROR IK RTO OOOO OK NK RR DRE RM 
{694% C 

(190439 . fear ee | LON THPLEMENTS Tee CALEGULATION OF KEYSTATE 
9190 c Teno tion PPOaaSsILitTyY, CONDITIONED ON ELEMENT TYPE, 
19240 C CURRENT OURATION, AND DATA RATE, 

19309 ¢ 

13409 & VARTAGBLESS - 

$9522 ie TeELEM= JNPUT CURRENT ELEMENT TYPE 

19622 E igi TXPUT CURRENT ELEMENT DURATIUN 

19724 C PeAte~ [reuT CURRENT DATA RATE 

{9649 g 

199a% a TABLES [NN COMMON CONTAIN DENSITY PARHS FCR EACH 

2gnaar c Be seN T= TYPE DATA RATE. 

29140 C 

24220 CP ERT SR OE eRE CS SESE ESSERE SEER ERE REESE SERRE SERRE EE SER EE SESE EE ESE EB 
20340 

2g4ye OIHMENSTON KIMAP (6) ,APARM(3) 

29540 DATA KIMAP/1,3,155357,14/ 

2444 Oren Awe Ani 4 Soho, 1509, 1.2 9U/ 

27 AAa 

20852 C 


20903 f. Sen cer OUR aT DONS AO OBTAIN DENSITY PARAMETER? 
21242 2 








a 30 MSCALESKIMAPCIELEM) 

e124} RSCALESsLeBa sIRATE 

2134 Se easulot Gear SCALE )} 

2,4 ALPS (03+5.)//7(4S9CALCeR SCALE) 
fam 2 

21662 (POtceamate.o) GO 10 27 
2b72e TFLIELEN,E9.5) GO Ta 19 
21agu ALPHASMSCALE*APANM(1) 

i GO TO 1Az 

2AWAA 

221G:A 12 ALP HAST, #APARM (2) 

2202 GQ T@ 1A 

2234) 

2244 2a Ab PaAS1 9, xAPARM(3) 

22580 

226 An jaa eG ele) GOIr 210 

227g2 Peet eta AN fed Gilet, )) GO TO 302 
(228 8H XY TRANSSE¥P (AL PHAR (31 BR) ) 
2292 | 6B. TO 422 

23a02 

Mev: 2 2A Pls ke CAC HAs (31 <4.) } 
232 47 Pas L em A DR EsZP(ALPHAa (A Ael,)) 
CRE TAM, LTRANS SP seu 

(23430 SQ 10 42% 

(23500 

2ahaA? 304 PiLa=y. Dee kr (=A Pras C3 p-1.) ) 
[23749 Poet see See AP CAL Prax (ited ,)) 
23820 Pies sie 4 OK) 


33ana 
0 





~~ 


24909 
244A 
242an 
24394 
20QA 
24530 
2462 
24794 
24830 
24992 
25422 
25109 
25203 
29300 
25440 
235920 
| 25920 


126900 
| 210008 
27429 
(27209 
2738 
274Ag 
215@4 
271h29 
2780 
(278A 
2929 
ae 





ea1G2 
(28292, 
2639 
2bayr 
2650 
25622 
26722 
(eBAZM 
28902 
(29020 
(291A 
 292EA 
093¢% 
04a 
09544 
(Ibu2 
29777 
29844 
09940 


| = 


GA} RETURN 
END 


SUBROUTINE PTRANS(KELEM, IRATE,LAMS0DA,ILRATE,PTRX, 
2 Pst, PIN,N) 


RMRRREMRERKE KKK REE RE KR RE RRR KK RRR MEHR KE KAA KHAKR 


ThIS FUNCTION SUBROUTINE RETURNS THE PATH CONDITIONAL 
Memo lt LIN PROBESBITLITIES fO EACH ALLOWABLE STATE N, 


VARTASLESS 
KELEMe INPUT CURRENT FLEMENT STATE 
TRATE« TNYPUT CURRENT OATA RATE STATE 
Pe tS0A—" INPUT JOENTITY OF CURRENT UTR STATE 
PTR X= THPUT KEYSTATE TRANSITION PROBABILITY 
ELEMTR=@ ELEMENT TRANSITIGQN PROBABILITY MATRIX 


FUNCTION SUBROUTINE JSED? 
SPOATRe FeETURNS DATA RATE TANSITION PROLS, 
CONDITIONED ON CURRENT SPACE TYPE, 


OSV Ge Oe |e eae 


Eee eee ee eee eee eee eee eee eee ee Ree EERE RES EER SSE RE EEE SS EE DE B, 


DIMENSION TELMST(490),ILAM1(16),ELENTR (16,4) 
CIMENSION ITLAMX (5) ,PIN(34) 


COMMON YSEKIANSILELMST, [LAM TLAMX 
CUNMON/ALKELM/ELEMTR 


C IF THe SAVED ELEMENT ANOQ THE ELEMENT OF THE STATE 
a N TO 4Hic4 THE PATH IS BEING EXTENDED ARE THE 
Cc SAME, THEN TEE STATE TRANS PROB ITS SIMPLY 
Cc PeYoreate Tsavs PROB: 
C 
TE CKELEM SNE -ILAMI1CIELMSTCLAMADA))) GO TO 149 
PIN(N) 2PTRX 
fre tfePalresenc,. 5) PINCNT SS, 
GU TO 2Q2 
G 
c OTHERWISE 
G 
C Miialt cele TRANS PSO8S FROM TABLE: 
iC 
146 PFLEMSELEMTRCIELYSTCLAMRDA), KELE™) 
c 
C PexXT COMPUTE ELEM@CONDITIONAL SPEED TRANS PRORS 
c 
PHATE SSPrTR(TRATE, TLHATE, <ELEM, TL AML CIELMST (CLAMBNA))) 
c 
@ PTRANS [8S Thnk PRODUCTS 
C 
PIN(N)S(1,ePTRK) *PELEM*PQATE 
ai, RESUMsPSuM4ePF In (M) 


ee 








30122 RETURN 
392GA END 
19302 
32400 
30522 
3hhG2 
34709 
33802 emer lone gPOTR(ToXT, TLRT, ISEIM, I ILELM) 
3299 
3yAgv ORPeeeeeseeeercererersereeeereeceeeereeeseeere ree eeeeeeeesceeeeeese &. 
31122 C 
31233 C TeIS FUNCTION RETURNS THE DATA RATE (SPEED) TRANSITION 
%13u2 C KFRKOAAGTLITY BASEN ON TRE CURRENT ELEM TYPE, THE ALLOW= 
314898 8 ABLE TRANSTTION PROBS ARE STQREG IN THE TABLE RTRANS, 
31994 C 
3699 é VARTAGBIDES: 
31742 Cc ISRT- MATA RATE IDENTITY FOR STATE TO WHICH 
31800 C PATY IS BEING EXTENDED 
31904 2 IL® T= DATA RATE ON CURRENT PATH 
3242 C TGELM=e FLEM TYPE FOR NEYT STATE 
32107 C Vee alee YE ON CURRENT PATH 
3224 @ 
32394 Cm mR RRR KK RRR KR RE RMKMKRE RE EKS 
3240 
32542 UIMENSIOMN RTPANS (5,2) ,™EMPR (A, 6) ,MEMDEL (6,6) 
32h COMMON/BLKSPD/RTRANS,MEMPR 
32744 CUMMON/BLKRATsSMEMOEL 
Yana 
| 329n0 C 
33300 C Peo eumewereNT SAND NEW ELEMENT ARE THE 
| $3492 Cc Spite rr Ee OCAN SE NQ SPEED C4ANGE: 
3$209 c 
33339 TECILELM.NE,ISELM) GO TO 4a4 
33a SPOTPal, 
33529 Peeters. 5) SPO TRS. 
Y3mq 4A GO Tf 3aA 
3732 
3$8n2 C 
33992 fc Oriani Seer AN SPEED TRARSSTLON PROS 
34442 Cc 
341 G4 
342G2 163 ieee veel (TLELM, [SEE ) 
$4393 Peowece We. CiLELM, [SELM) 
AO [iti NEo4) GO JO eaa 
345.20 SPOTIsSH, 
—( MAA S$) To Zur 
347av 
et: Vay eAY [VELSPSC(S2T ase IOEL 
34999 Se eee eada (1 SRT, 1) ) 
$5004 ISRATESILARTH+IDELSS 
$3129 IF CESRATE.GI.49) SPOTR=E4, 
S224 Petlomate.t tT. it) SPOTR=%, 
35344 
$day $40 Re TURAN 
3952. Edd 
3367 
| 397ae 
S824 
: 39943 
Lj 2 





BL 
(36142 
my-)-4/29) 
36309 
yo4an 
392A 
36632 
36740 
3842 
36°09 
37AG2 
ids 
37202 
37328 
37492 
37942 
37634 
7724 
37822 
37922 
58994 
ian 
(38234 
383a2 
48420 
38533 
Jana 
38722 
36490) 
3a9u2 
9A aA 
39130 
39223 
39334 
$9420 
39522 
$9632 
39730 
398o% 
399G4 
Ge) 
Gala 
YADA 
149329 
IWGGGA 
vay 
Brine, 
“AST QA 
(AGRA 
4994 
| ALAA 
bALLaa 
(ana 
WB Ga 
Wl4er 
Wi52a 
Wane 
44729 
dt aay 
W902” 











SURROUTINE PATH(IP,LAMBD4,OUR, ILRATEsLAMSAV, DURSAV, ILRSAV) 
Cece e ee eerereeeeseceeeeeeeeeceeeeeeeeerrrrerrerrercCererrerErrerrrerecee ns 


PATH COMPUTES THE LTR STATE, DURATION, AND DATA RATE OF 
EaCH NEw PATS EXTENDEG TO STATE N, 


Via see ote 


TPa SAVED PATH IDENTITY 
erase Lhe STATE OF SAVE! PATH 
Dy fe GURATION QF ELEMENT ON SAVED PATR 


Pieenee= DATA RATE CF ELENENT ON SAVED PATH 

Scsav= he Ew EIR STATES "POR EACH PATH EXTENSTON 
DHURSAV= NEY ELEM OURATIONS FOR EACH PATH EXTENSTON 
ILPSave NEN DNATA RATES FOR EaCrn PATH EXTENSION 

io NEW PATH IDENTITY 


escent s tT SOP eT ARLE, MEMFEN, IS STORED IN COMMON, 


T2OP OF OVO OVOP ee OO ara ae ae 


MRK RM RR KK MMR RRR NKR RRM KK RRR KR ER KR M KE KRARKARRAKRRHEARHEHS 


NIMENSTON LAMSAV( 758),DURSAV( 750),ILRSAV( 7549) 
DIMESTON YESFON(492,6),TELNST (C494), IL AML C16) 
CIMENS LON [ieeiii(S),15% (6) ,MEMDEL (6,6) 


Gover PUKE AM/ TERRA, PLAT, TLAMX 
SOMMON/OLKMEM/MEMF CH 

Roa aN, RIK S/T SX 
COMMON/BLIRAT/MEMIEL 


c POR FACH ELEM STATE K, ANDO EACH SPEEN I, COMPUTES 


Cif f=1.5 
CO 129 *21,6 


G 
Sa eweee NI ny sts 
c 
ae tema eG + 
c 
eC Meer Aye ThOENT ITY § 
C 
Psa (C[T Pay) «2UeNn 
S 
c oye fe om alae £ 
C; 
(ieee ne ee) SO UT 62 
a een Cle) a. 
G0 TQ 144 
6 & PAA (ee NEM PCN CUANMGDA, K) 
Pee icone oe ee) GO TC 14 
c 
C Aer ie] Likes 
e 
ss Oe ey Saye er SAVED PATS AND NEw STATES 
fc 


is) 3 





—429ae 
Weide 
W2204 
42302 
gedael 
Wa5an 
426d 
ye72a 
W284a 
42942 
43494 
43107 
432g? 
43302 
agagu 
43522 
¥34y2 
43733 
43842 
4392% 
a4e2d 
d4yaa 
ugar 
44379 
444 ya 
4459 3 
44634 
W47 AQ 
448au 
a49a4d 
45044 
45159 
W520 
453aa 
45494 
45530 
WSOaA 
43722 
4982 
45904 
loner 
WeLua 
dhaar 
degnr2 
4a G 
W652 
4bhya 
46722 
WHR ASS 
Wh9A9 
(Aeaa 
ATMa2 
(Tea 
473232 
hice 
(AIMS 44 
(Tee 
oie 2 
ATA GA 
, ie 
) 


tl 


‘ee op A Se, 


14 


23%) 


ILELMSILAM1 (IELMST CLAMBDA)) 
Almere AMS CILELM) 
AO ok CS) 


Cee ew ceeeiiRay TON $ 


DURSAVC J) sDUR« CLpelXSeTkL ean Et XSeITXL) +5. 


Nev 


Vaca AT. 


eer Catt Rat et (le S)RMEMDEL CILELM, K) 


Soe ie Line 


RETURN 


FNL) 


Se Or PNe wht KANO(Z, RN, [P,LAMBDA, DUR, 


e YWeRATE.PeLAHN) 


WECt eee eee rece rcereeeereeecereseeeeeerererercreereeeeeeerrceereercere sc | 


Mart) toe 6) oy Or ae eee oie ee) 


o 


Pres SURRO Tee CALCYLATES, 
nee S [Are N, 
SIVEN 

ENE AR CRA Aas) FILFERS to DO SG. 


EXTENSICN 
DR AN ST 1 GN 
AN ARRAY OF 


VaelLAgLES Ss 
= 
ar ie 
e= 
laMADA@ 
Dish w 
ILeaTee 
Die 
LaHD = 


SUBRILTINVES 
fer ils 


oe 
IIS 
INPUT 
INPUT 
INPUT 
INPUT 
INPUT 


ane 


FOR EACH PATA 
Tee TK ELTHOOD GF THAT 
MEASUREMENT 7, (ieee > 


MEASUREMENT 

NOLTSE PUWER ESTIMATE 
SAVED PATH IDENTITY 
SAVeEbmetReS TATE TUENTITY 
SAVED MNURATION OF FLEMENT 
SAYED DATA RATE (SPEER) 
TRANSITION PROSABILITIES 


ON PATH [P 


eo eO IK ELI MOG o POR EACH TRANS 


ote s 


KALMAN 


FILTER FOR FACH NEW PATH 


MERKUR REMARK RK KEM K KERR ERK KEKE RKRAKKEKEKEKRE KKM EKAR 


EAL LEED,LAHOJ 


CIMENSTOS: 
A ITMENS TON 


freeS, S47 KO C7 5) 
Peers (ang. Tilat{ (16) > lL Awe (6) 


CIMENSTIQN [5X (46) 


Sse Aina, TELM ST, [LAM?, [1 AMX 
CUMMON/BELKS/TS*X 


OBTAIN sAVE 


KEYS 


(Ps) ee 


aoe te Wail Sy (AMADA) ) 
Mest iets Y(KELE 4) 


174 





—-48eA8 
481 na 
48249 
483.490 
§addZ 
ug52a 
48600 
4a724 
48393 
ya9n 
§9Ayo 
49iga 
492a9 
49382 
494Qa 
495aa 
49602 
497g8 
A9BYA 
4992” 
SUAgY 
sdidd 
syean 
5a3an 
Saga 
53504 
306024 
5974 
‘Saag 
Sudan 
518A 
Sjiga 
Syeaa 






m7oOm 


oe es: 


BIR PACH STATE 


Shier ce yo olen katc STATE, STATE 


CO {AQ KS1,4 
PO yaa L!t,5 


I, NEW NODE? 


TxssISx(X) 
Pon ales 

Ne (Taj) «h+K 
JsCtTP=j1)«#3atN 
PINsPCIP,N) 


SOP 80 stone LIKELIHOCGs 


LAY 


PIES 


ae A ey tage N, [tax Xo, KELEM, Je ISRATE, 
OUR, ILPATE,FIN, LKADY) 


LkHY CJ) si KHOJ 

GQ TN 1a4 

Porc tietee th beG6) G60 10° 100 

TYPE 1397,1P,Z,LANBDA,K, [LRATE, ISRATE,OUR,PIN,LAKHOJ,RN 
Oni mee pls Og Sneek pl Spe%, ligeX, la, e2X,ler SXsF Sel. 
CG, © Be ore See wr o. 4) 


CONTINUE 


RETURN 
aa) 


1 eyes. 





q01a4 
—6gne2u 
10324 
pgaea 
0504 
—906u? 
ag724% 
ngage 
a09ee2 
AAG 
AL1aa 
hjyedd 
ay3ae@ 
a4429 
21562 
0,6ar 
d17ed 
Apaya 
MIGA 
22007 
re1 40 
(222? 
A524 
rede? 
AeSYA 
(42602 
02799 
P28YA 
82990 
—685age 
Osta 
3222 
A332 
h3aga 
03502 
—6t56a? 
A37Q9 
A3ADA 
b390g 
AGA 
ML Aa 
BA Ye 
Mb Sue 
MUA? 
M4594 
Mbdd 
‘ta7Tay 
M4aa2 
C4QMIA 
25M aA 
ISL Aag 
Seve 
133u4 
—(*NSaan 
"3500 
ADH 22 
A3Tva 
29874 
*99u0 
2EAAA 








SUPmew TNE RACFIL(Z, TP,RN, TEX, EXS, <ELEM, 
2 JNONE, ISRATE,OUR,ILRATE,PIN,LKHDOJ) 


SRE eee eee eeSELESEE LESS SESSESESEESSE SOS ESOS ESSE ESE SSS ESSERE SO EE & 
C 

C THIS SUBROUTINE COMPUTES THE ARRAY OF KALMAN FILTER 
C; weemrolOMs USED TO DETERMINE THE LIKELIWOONS, 

C 

E VARIABLES? 

‘@ = INPUT MEASUREMENT 

c IP= INPUT PATH [DENTTTY 

C Qn= INPUT NOISE POWER ESTIMATE 

C TLXe« INPUT SAVED KEYSTATE ON PATH [PP 

C 1xS-= TNPUT KEYSTAT OF NEW NODE 

fe KeLeEM= INPUT ELEM STATE OF NEW NODE 

& Por Alb~w lineout SPEED STATE Gh NEW NODE 

C; GULF -« IN?®Y CURRENT OURATION OF ELEMENT ON IP 

C ITLRATE= INPUT SPEED STATE ON PATH IP 

‘a DTN» TRANS PROB FROM PATH [TP TO NODE N 

C Cuero ure) CALCULCATEO LIKELIHOOD VALUE 

C 

ie SUBROUTINES USED 

C MODEL@e® GSTAINS THE STGNAL@STATESDNEPENGENT LINEAR 
Cc MONEL FOR THE KALMAN FILTER RECURSTONS 

c: 

Sec eeeecrecrerrCeeerercrrcrercrercrcerrrooreecreErCeLrELrCErLEOCeCrcreCoCEOCSCCLeECeae & ee eo: 


gs EAT Ss sp re 
tao tee C25) ,PK5 1° (25) 
DIME een oy (7 50), PKKSYV (759) 


COMHON/BLKSVYL/YKKIP,PEKIP,YKKSV,PKKSV 


ath YRRhP/ esa / Pal Pye ss, 1 2/ 
JQATA PINMIN/ ,AGA1LE/ 


ie 
C Poort Po PROB ARMIETTY LS VERY SHALL, DON’T 
C Alita sth WYK EL IAGOD CALCULATIONS 
9 
Pee LN Gi Pr INAINI GO To (a2 
Larisa, 
Q) TO 4A 
iD 
‘is GeTlaih STATESHERPEVNENT MQDEL FARAMETERS? 
C 
1G CAGE TODER TOUR PRELEW, SExATE, [SRATE,ITX¥S,PHI,QA,HZ) 
e 
Cc Pome Re VIOUS eat [MATES FOR PATH IP 
Cc 
YRC) Ge Cle) 
Pek sPKK DP TP) 
G 
C Pervee Ve WiRRIMAY FILTER FUR THIS TRANSTTIONS 
C 


EO 





(96192 
16230 
e304 
16409 
(9658 
19a 
(96704 
16899 
Ho99R 
‘41000 
ee 
“17e@a 
7320 
171408 












1812% 
Mesa 
18342 
HGaGa 
14522 
2602 
OBTA? 
‘2b8ar 
28902 
49039 
e91aa 
M20 
29322 
9422 
29590 
29602 
29736 
29842 
29982 
WGae 
{ata 
laeaze 
la3aa 
‘(ada 
1d5ae 
Ldm 2a 
1QTua 
1Q8aa 
(9900 
jana 
11489 
Lea 
1322 
{aoa 
1526 
{o2A 
{729 
{Raa 
‘W92e 
AAD 





eu 


fe ail 
idly 


YPRED2PHI «YKK 


PRPREOSPHIT aPKK xePHI +i, 
PZ2aHZxPPREN4eRN 


PZINVSL,/P2Z 


GSsPPREDeHZaPZINV 


PESTS (1,.=G#HZ) xPPRED 


ZRaZoriZxeYPRED 


YKKSV(JINODE) SYPREN+¢GaZR 
PKKSV(JNQGE) sSPEST 
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Soca Val Cove ota TRANSITION MATRIX PHI, 
MEASUREMENT 


ite 
TeLM= 
[LR 
ItSRe 
UxSe 
PuTtAe 


SP Gn 


6 A J 


“Jw 


MATRI¥, 


Peat 
TNP'UT 
INPUT 
fete) 7 
[INPUT 


THE 
THE 
AND THE COVARIANCES, 


PEBVENT OURATILCN 

BL EMew. TYPE 

SAVEO RATE 

oe eee pein Soo pr ye 
KEYSTATE OF NEw STATE 


NQUTPUT STATE TRANSITION MATRIX ENTRY FOR 
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